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PREFACE 



This report presents data and interpretations of data relevant to 
classroom trials of ME NOW, a life sciences program for the educable 
mentally handicapped prepcured by the Biological Sciences Curriculum 
Study. 

A vote of thanks is extended to Dr* James T. Robinson who 
assisted in preparation of Chapter I and the initial part of Chapter II 
and to Roy 0. Gronmie and Harold A. Rupert, whose comments and sugges- 
tions have been very helpful in the preparation of this report. 

The canpleteness of the data reflects the dedication to the pro- 
ject of teachers in the ejcperimental amd control groups. The inter- 
pretations of the data are the sole responsibility of the project 
evaluators . 



Richard R. Tolman 
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CHAPTER I 

ME NOW, A LIFE SCIENCE PROGRAM 
FOR THE EDUCABLE MENTALLY HANDICAPPED 

Introduction 

This report presents drta and interpretations of data that describe 
the results of classrocxn trials of the BSCS Life Sciences for the Educable 
Mentally Handicapped, Intermediate Grades Progr^, developed with funds 
from the U. S. Office of Education, Bureau of Education for the Handi- 
capped. Detailed description of the instructional materials, the 
curriculum rationale, and other facets of the project have been described 
in rsCS Newsle\:ters 36, 38, 43 and 46, Copies of the Teacher's Guide 
are available from Kubbard Scientific Company. 

Classroom trials of Unit I, Digestion and Circulation , were con- 
ducted in the spring of 1970. The formative evaluation of these materials 
has been briefly reported by the Biological Sciences Curriculum Study. "^'^ 

This report describes the formative evaluation of the classroom 
trials of Units I, II, III, and IV conducted during the school year 
1970-71. The Unit I Teacher's Guide was revised for this evaluation 
study cuid revised data collection instruments were developed. Revisions 



Richard R. Tolman and James T. Robinson^ "Formative Evaluation of Unit 
I, Digestion and Circulation. " BSCS Newsletter 43:7, 21 (April), 1971. 

James T. Robinson and Richard R. Tolman. A Formative Evaluation of 
ME NOW Unit I, Digestion and Circulation . Boulder : Biological 
Sciences Curriculum Study, September 1970, 97 pp. (ED 043182) 
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were based upon recommendations suggested by Robinson and Tolman. Units 
II, III, and IV were developed in the summer of 1970 and were tried in 
classrooms for the first time in 1970-71. 

The completeness of the data reflects the cooperation of the experi- 
mental and control group teachers and the exten? zs of Harold A. 

Rupert, Jr., and Roy Grcmme, BSCS Staff Consultan-'is , in visiting classes 
and working directly with the trial teachers. The interpretations of 
data are the sole responsibility of t'lii evaluation staff. 

The Curricuj^um 

Tlie materials of the ME NOW program consist of a Teacher's Guide 
that presents suggested teaching strategies and all of the associated 
materials needed by teachers and pupils. There is no student text as 
the program relies heavily on activities supported by a variety of 
instructional materials. These include 35mm daylight projection slides, 
individual pupil worksheets, charts, models, films, laboratory equipment 
and evaluation instruments. 

The initial field-test materials were designed and structured to 
conform to a particular philosophy, a set of general objectives, and 
some basic assumptions. The validity of all of these is questionable 
to some degree, simply because of the limited knowledge available 
regarding special education curriculum construction amd because of 
the unsolved problems facing all educational endeavors — especially 
those in special education. Among these problems are: 

— the variability of the population described as mentally 
handicapped. 

i 
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— the limitations of instruments and judgments used to assign 
pupils EMH classes. 

— J-/- yxon. of low teacher expectations (and low pupil self- 
image) • 

— the lack of existing guidelines or exemplars of effective 
materials for curriculum design for this population. 

— the complexities of conceptual frameworks in science as they 
are represented by the discipline. 

— disagreement among curriculum workers concerning the use and value 
of behavioral objectives. 

— lack of consistency among evaluation models. 

— limited teacher knowledge of science and experience with science 
materials and procedures. 

In spite of these problems, the BSCS staff proposed to establish and 
to work within a "reasonable" framework of hypotheses regarding what is 
possible to achieve, and to modify this as experience dictates. This 
framework is contained in the philosophy and general objectives estab- 
lished for the project. 

Philosophy of the Program 

All children are entitled to equal opportunities for self-development 
to the fullest extent of their individual physical, mental and emotional 
capacities. Because children with mental handicaps do not have the same 
ability to -adjust and to learn effectively in the usual classroom as do 
so-called normal children, they should be provided with instructional 
programs specifically designed for their needs and abilities. Meeting 



those needs — and determining those abilities — requires the provision for 
learning experiences that make it possible for handicapped children to 
achieve both mastery of useful concepts and a sen50 of personal satis- 
faction with the learning experience. 

Throughout the program, students should confront real phenomena in 
such ways that their curiosity is aroused and th^ desire to investigate 
further is encouraged, it is not always feasible, however, to allow each 
student full freedom to discover knowledge for himself. There are prob- 
lems of classroom management to gain the fullest opportunity for every 
child. These materials, therefore, were structured to provide the stimulus 
to curiosity and then to guide students through inquirin g kinds of activi- 
ties; such as observing, describing, identifying, comparing, associating, 
inferring, applying and predicting. 

The application of inquiry methodology to the learning activities of 
EMH students is still largely based on intuition. However, preliminary 
observations of the strategies proposed in this project seem to indicate 
that students are, in general, highly motivated and that learning does 
occur. Until sufficient evaluation data are obtained, prejudging the 
extent or limits of the student's ability to learn through inquiry is to 
be avoided. The student should be given tlie opportunity to perform in 
these modes to the highest level of effectiveness he can attain. 

Two hierarchies are presumed to exist in the materials. One per- 
tains to a level of cognitive difficulty and the other to a logic for 
the sequencing of content elements. 

The staff and committees have considered and accepted, for this 
curriculum effort, one hypothesis with respect to the relationships 
between inquiring behaviors (or performance objectives) and cognitive 
difficultv. This hvpothesis is expressed in Figure 1. 
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Figure 1, Presiamed Levels of Cognitive Difficulty 
Although performance objectives and classroom behavior may range 
across the four levels of difficulty without overt limitation, it is 
assumed that the EMH child will profit from a design that proceeds— 
where possible-from simple to complex, from concrete to abstract, from 
external to internal, from what is familar to what is unfamiliar. How- 
ever, depending on the nature of the content, a child may, for example, 
be expected to associate ideas or objects that are familiar to him 
without first describing them. 

It is also assumed that the child should be allowed to study single 
^^^"'^"^^ °f ^ system before being asked to consider interactions of 
those elements. Similarly, a child might be expected to focus on the 
functions of an element before he is expected to associate a name with 
those functions. 

Until decisive data to the contrary are obtained, it is assumed 
that the EMH child is able to perform effectively across the four 
levels of complexity, but within a reasonable range of difficulty 
commensurate with a high percentage of individual motivation and success. 
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Performance O bjectives 

A major commitment of this project is to specify performance 
objectives for the EMH pupil population and to design activities 
through which these objectives are to be attained. The specification 
of objectives is influenced least by biology, and most by the EMH 
pupil population. Biology is a source of information about life and 
a source of understanding of the methods by vrtiich this information 
is obtained. But there are perceptual, emotional and other learning 
difficulties as well as practical considerations for the welfare of 
tl:iese children in a competitive and often indifferent society. A 
reasonable mix of these considerations was sought in order to provide 
a useful, meaningful and effective curriculum in life science for 
the educable mentally handicapped. The content is not to be pursued 
to a depth greater than the ability or need of these children to absorb 
it. Nor will these students be involved in intellectual operations 
beyond their abilities to perform. These limits are not readily identi- 
fiable and both optimism and restraint must be applied to the development 
of reasonable nypotheses in this regard. 

The selection cind statement of performance objectives for this program 
represent an effort to specify (1) those content elements that represent a 
reasonably complete picture of structure-function relationships , (2) 
cognitive and psychcraotor operations the student will perform during 
instruction ; and (3) what the student will know, or be able to do on 
his own when an activity sequence is completed . Individually and 
collectively, these three factors represent the bases upon which the 
effectiveness of the materials and the instruction on the learning of 
the child should be evaluated. 

ERLC 
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The model for inquiry used in these materials demands that the focus 
of classroom activity be on the student with materials and activities. 
The teacher functions as a catalyst in generating pupil responses in the 
learning situation. The response desired may be attitudinal, cognitive 
or psychomotor, verbal or non-verbal. The teacher's behavior also falls 
in these same categories, but with an important difference: The teacher 
must be totally conscious of her role as stimulant while the student is 
generally unaware that he is being manipulated by strategy. 

To communicate maximally with the novice teacher, or the experienced 
teacher who is willing to be led through a structured program, as much as 
possible of the pattern of interaction upon which the anticipated results 
depend is carefully described. Teachers often fail to allow children the 
opportunity or the time to think for themselves when a problem is posed. 
They also frequently impose their observations and interpretations on 
children rather than allow the children to express their own views of 
things observed. Therefore, teachers are provided a model of strategy 
in these materials that will — if initially studied and used — demonstrate 
the benefits we describe for it in terms of pupil response behavior. 

All that will occur with individual students in the classroom cannot 
be predicted, but enough reminders are provided to teachers to enable 
them to deal with unexpected or unpredicted events in the same mode in 
which the materials are written. 

General Objectives 

1. To help the child develop interests, skills, and positive 
attitudes through experiences with science and biological 
concepts . 

ERIC 



2. To provide the child with challenging intellectual activity 

at a level commensurate with his ability to respond effectively. 

3. To aid the child in establishing acceptable and functional 
modes of living through heightened powers of observation, a 
well-developed curiosity, a good measure of self-confidence, 
and a sense of responsibility to and for his environment. 

4. To contribute to the development in the child of a high 
level of social maturity and emotional stability that can 
lead to increased vocational proficiency, realistic self- 
concept, creative self-expression, and more effective 
assimilation into the community. 

5. To develop in the child a knowledge of himself in relation 
to his environment, as well as a tendency to apply this 
knowledge to the tasks of everyday living. 

6. To contribute to incresised knowledge about the learning 
chsaracteristics and limitations of the educable mentally 
handicapped pupil, and about effective strategies for 
instruction. 

7. To assist the teacher in developing a classroom atmosphere 
and instructional modes most conducive to the attainment 
of these objectives. 

To further narrow the range of possible development strategies, a 
set of tentative assumptions that would serve as criteria for curriculum 
design was prepared. Whether factual or not, these assumptions were 
considered acceptable by the committees of teachers and specialists who 
have been instrvimental in reviewing and testing the materials. 
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Basic Assumptions Underlying the Design 
of the Curriculiim Materials 

1. Most teachers of the educable mentally handicapped will need 
specific direction in the use of inquiry strategies in the 
teaching of science concepts. 

2. EMH children need and can respond effectively to an activity- 
centered instructional approach. 

3. To achieve the objectives, materials should maintain a balance 
between detail and motivation, for the amount of minute and 
abstract detail that can be learned is probably a function 

of the interest and motivation that can be established to 
deal with it. 

4. The classroOTi environment and the materia] s should be uncluttered 
with distractors; however, a variety of perceptual modes and 
instructional media should be used in all efforts at communica- 
tion (e.g., sight, touch, smell, etc.). 

5. An activity must involve the s^-.udent in ways of applying the 
desired behavior; transfer, cannot be assumed. 

6. Activities should be developed in small, discrete unit£= that 
build on or reinforce a concept or skill. 

7. Entry points should be concerned with concrete, tangible 
"things" rather than with abstract, intangible ideas or 
concepts. 

8. Ideas must be developed without the necessity for reading 
on the part of the student. 

9. Vocabulary, where possible, should involve functional language 
rather than technical terms. 
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10. For the EMH student to learn/ the instructional approach 
must be slow-paced and redundant, and there must be time for 
participation by each stu^Tent. 

11. Efforts to describe the "average" EMH child are essentially 
futile because of variability within the population; therefore, 
materials and methods should allow for attention to individual' 
differences and needs. 

Policy committees, working within the constraints of the program 
philosophy, general objectives, and assumptions, prescribed an initial 
focus on the following content areas: 

Part I: ME NOW, Structure and Function 



Later units are to explore a variety of environmental and ecological 
concepts. This report presents the results of the classrocxn trials of 
the four units listed above. 

Design of the Formative E valuation 



Unit I , 
Unit II, 
Unit III, 
Unit IV, 



Digestion and Circulation 

Respiration and Excretion 

Movement, Support, and Sensory Mechanisms 

Growth and Development 



The design for classroom testing of the four units of study proposed 
in a summer writing conference (1970) is presented in Table 1. This 
design followed that used in the initial study of the efficacy of Unit 1, 



14 

as described by Robinson and Tolman^*^ The design is an adaptation of the 
formative evaluation model proposed by Stake. ^ 

The design presented in Table 1 included as many recommended changes 
as were possible within funding limits. Unfortunately, the funds recom- 
mended for observation and data gathering of teacher-student transactions 
were again eliminated from the budget* 

Support for providing 16 classes with the experimental materials 
precluded any significant prospect for random selection of trial class- 
rooms. In addition, tJiere were several important considerations for 
selection of specific classes at the current stage in the development 
of the curriculum materials : 

1. representation of youngsters in cities, suburbs, and rural 
environments; 

2. location near universities with active faculty interest in 
improving instruction for the educable mentally handicapped; 

3. clustering at least two classrooms in close geographic prox- 
imity to reduce costs of staff visitation and to permit 
rapid exchange of shared materials. 

Sixteen experimental and sixteen control classes were selected for 
the 1970-71 formative evaluation study. Experimental group teachers 
administered pretests prior to instruction for each unit and posttests 
after the instruction for each unit was completed. Pretesting for Unit I, 

3 

Ibid. 

4 

Robert Stake. "The Countenance of Educational Evaluation." 
Teachers College Record 68:523-540 (April), 1967. 



in both experimental and control classes, was conducted in the first 
week of November, 1970. As experii[.ental group teachers proceeded at 
their own rates, test administration after the first pretest varied 
considerably.^ Control groups administered pretesting and posttesting 
on a regular schedule. A parallel form test design was used, as shovm 
in Table 2. 

Table 2, Data Collection Program for Each of 
Four Units of the ME NOW Program 



Group 


Protest 


Treatment 


Posttest 


Other Data 


Eacperimental 


8 classes 


BSCS ME NOW, 
Unit I, II, III, 
or IV 


8 classes 


Student char- 
acteristics 


16 classes 


Form A 




Form B 


Teacher 
report form 


166 students 


8 classes 
Form B 


Teacher report 
forms 


8 classes 
Form A 


Classroom 
visits by 
BSCS staff 


Control 


8 classes 


Regul ar 
curriculxam 


8 classes 


Student char- 
acteristics 


16 classes 


Form A 


No reports 


Form B 




168 students 


8 classes 
Form B 




8 classes 
Form A 





Ex perimental Classes 

One classroom in Boulder, Colorado, was selected for trial use of 
the ME NOW Program to provide easy access to the development staff and 



This variation will be considered with the discussion of each 



unit. 



See Appendix I. 
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to the many U. S. and foreign visitors who visit the Biological Sciences 
Curriculum study. Three additional Colorado classrooms, two in the 
Denver area and one in Pueblo, were selected to provide for a diversity 
of classroom conditions within driving distances of the BSCS offices. 
The two Denver area classrooms were also convenient . jr visitation and 
research participation by graduate students from the Univer<?ity of 
Denver. 

Two classrooms were selected in Des Moines because of the interest 
of the Division of Special Education of the Iowa State Department of 
Education, and the desirability of testing in the Midwest. 

The remaining ten classes were all located near universities with 
active interests in special education and, in several instances, in close 
proximity to special education Instructional Materials Centers. These 
locations, with two classrooms each, were: Eugene, Oregon; Salt Lake City, 
Utah; Las Vegas, Nevada; North Worchester County, Massachusetts; and 
Pinellas County, Florida. 

The sixteen experimental classes, distributed across the United 
States, were located in pairs to reduce staff travel costs, and were 
generally near cooperative universities where preservice and inservice 
special education students could easily visit cind they were located in 
different sized communities and wivhin different areas of those 
communities . ^ 

Control Classes 

Control group classes were selected for geographic distribution 



See pages 14-19 for a description of the schools and student populations. 



and ease of arrangements. The schools conducting these classes agreed 

to adhere to a strict schedule for administering pretests and posttests. 

Control classes were located in Alton and Wood River, Illinois; Fort 

Worth, Texas; Pittsburgh and Huntington, Pennsylvania; Des Moines, Iowa; 

Clearwater and Tampa, Florida; Aurora, Arvada, and Wheat Ridge, Colorado; 

8 

and Lancaster, California. 

The Student Group in the Evaluation Study 

Intermediate grade youngsters in special education classes are 
generally characterized as t>eing 11- to 13-year-olds who have exhibited 
evidence of learning difficulties in regular school classes and who 
have scored from 50 to 80 on individually administered intelligence 
tests. Background data for classes using the BSCS ME NOW curriculum 
(experimental group) and for classes using their regular curriculum 
(control group) were gathered during the last week of October, 1970. 
One hundred and eighty students were enrolled in 16 experimental classes 
and 187 students enrolled in 16 control classes. Complete data — background, 
Unit I pretests scores and Unit I posttest scores, were secured for 166 
(92%) of the experimental group. The remaining eight percent are not 
included due to the trcinsf erring out of the class oi school while other^i 
failed to take either the pretest or posttest. Teachers administered 
both pretests and posttests to students who were absent from class on the 
day of testing if the student was available for testing within three or 
four days. 



Ibid. 
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The experimental and control groups, ^escribed below, are the groups 
whose progress will be reported in each section of the report. Only when 
the groups for a particular unit of study differ markedly from the initial 
groups will further discussion be presented. This does not mean that 
exactly the same students are included in the student population for each 
unit of study. 

The experimental group ranged in age from 78 to 193 months with 
a mean of 144.60 months, as shown in Table 3. A total of 21 students 
were older than 13 years and 12 were younger than 11. Only 2 students 
in the experimental group had measured IQ scores^ of under 50, but 21 
had scores above 80. The laean total IQ for the experimental group was 
71.84. 

Ethnically, 77.1 percent of the experimental group students were 
whites, 12.1 percent were blacks, and 10.8 percent were Spanish-Americans . 

Teacher-rankings of reading achievement place 11.4 percent at the 
readiness level, 21.7 percent at first grade level, 28.9 percent at 
second grade level, 21.1 percent at third grade level, 12.7 percent at 
fourth grade leve] , and 4.2 percent at fifth grade level. "^^ 

Students also were ranked on a low to high scale of 1 to 5 according 
to the teachers* estimates of their verbal participation: non-verbal 
being ranked 1; average, 3; and very verbal, 5. Rankings were 7.8 
percent, 1; 21.1 percent, 2; 28.3 percent, 3; 25.3 percent, 4; and 
17.5 percent, 5. 



Wise total IQ score. 

I 

See Appendix 2 for instruction 
securing background data. 
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Four of the sixteen experimental classes were composed of students 
in urban. Title I target schools in Commerce City and Pueblo, Colorado; 
Salt Lake City, Utah; and Eugene, Oregon. Five classes were from low 
income, xarbcin areas in Pinellas Park and St. Petersburg, Florida; 
Henderson, Nevada; Fitchburg, Massachusetts; and Des Moines, Iowa. 
Both Florida classes are located in special schools for handicapped 
children. Two classes were from low income, surburbcm areas in Eugene, 
Oregon and Des Moines, Iowa. Five classes were located in middle 
income surburban eoreas in Boulder and Littleton, Colorado; Salt Lake 
City, Utah; Lunenburg, Massachusetts; and Las Vegas, Nc a. 

Background data, pretest cind posttest scores of the control group 
were secured for 168 (90%) of the 187 students (see Table 4) . The 
control group students were slightly older than the experimental group 
with a mean age of 147.85 months and an age range of 116 to 177 months. 
Twenty-one students were over 13 years old and 7 were under 11 years 
old. Fifteen students had measured IQ scores of over 80, one student 
had a score below 50, the mecin total IQ was 70.20. 

Ethnically, 77.4 percent of the control group students were whites, 
19.6 percent were blacks, and 3.0 percent were Spanish-Americans. 

Teacher remkings of reading achievement placed 9.5 percent of the 
control group at the readiness level, 24.4 percent at first grade level, 

28.0 percent at second grade level, 17.9 percent at third grade level, 

16.1 percent at fourth grade level, and 4.2 percent at fifth grade level. 
Teachers' assessments of verbal participation, on a low to high 

scale of 1 to 5, placed 10.1 percent at level 1, 24.4 percent at level 
2, 25.6 percent at level 3, 25.6 percent at level 4, and 14.3 percent 
at level 5. 
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Of the sixteen control group classes, one class in Alton, Illinois 
was in a school classified as a Title I target school in an inner-city 
ghetto. Two classes were composed of low income, ghetto students from 
Fort Worth, Texas and Pittston, Pennsylvania. Five classes of students 
were from low income, urbaji areas in Des Moines, Iowa; Clecirwater and 
Tampa, Florida; Forth Worth, Texas; and Security, Colorado. Both Florida 
classes were located in special schools for handicapped children. One 
class was from a low income, surburbaji area of Des Moines, Iowa. Four 
classes were from middle income, suxL/uxLan areas of Aurora, Arvada (2), 
cind Wheat Ridge, Coloreido. Two classes were from middle income, urbcin 
areas of Wood River, Illinois cind Lancaster, California. One class was 
from a middle income, rural area of Lancaster, California and one class 
was from a low income rural area of Huntington, Pennsylvania. 

The data gathered support the interpretation that both the experi- 
mental and control groups were members of the population for whom the 
materials were designed. Limited financial support for evaluation did 
not permit random selections of either experimental or control groups 
cind, therefore, nothing can be stated regarding the representativeness 
of either group in terms of the national 11- to 13-year old EMH 
population. 



CHAPTER II 
EVALUATION OF UNIT I 
DIGESTION AND CIRCULATION 

The Instructional Program 

Instruction for all experimental classes with the revised edition 
of Unit I began in November, 1970. One class completed instruction 
before the Christmas holidays and tl.^ last class finished the unit the 
last week in February, 1971* The total time in class devoted to ME NOW 
during the period ranged from 865 to 3,055 minutes with a mean for the 
16 classes of 1,228 minutes (20.5 hours). 

The fate of food in "Me" and the distribution of digested food in 
"Me Now" is the focus of Unit I. The first activities in Unit I about 
food may be extremely easy for the student. This is by design. The 
ease with which the student is able to attain success will lead him, we 
hope, into an interest in science. A success syndrome may thus be 
established in a curriculum content area that has often been neglected 
in working with mentally handicapped children. 

Food is tangible and concrete — something we see and touch every 
day. Students are introduced to the fate of food by observing and 
tasting, and thereby identifying and describing characteristics of food 
before it enters the body. Associations with food needs are developed 
with student- focused activities. Relationships between food character- 
istics and the functions of the teeth, tongue, and mouth parts involve 
the students in an examination of chewing and swallowing. 

The students develop ideas about the disappearance of food from 
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the mouth and establish that there is a tube connecting the mouth to 
the stomach. They investigate stomach action by listening to stomach 
sounds and by manipulating a stomach model. 

To answer the question of the fate of food in the body, the student 
must investigate not only the process of digestion, but also the processes 
of food distribution and utilization. The distributive function of 
blood circulation is examined next. Here again, the obvious and familiar 
external evidences of circulation — heartbeat and pulse — serve as the 
entrance point to instruction. The students infer associations between 
heart action and the resultant pulsing of blood cis it circulates through 
the body. A simplified working model of the circulatory system is con- 
structed by the students to illustrate additional functional relation- 
ships . 

Finally, the process whereby digested food in the intestine passes 
through membranes into the blood is demonstrated. Through specifically 
designed activities, the students are able to observe the simulated 
movement of food in solution through a membrane, and to associate what 
they observe v;ith what actually occurs in the body. The process of 
food utilization is studied later in Unit III. 

It is especially important in this first unit to allow every 
student an opportunity to participate in the activities, for it is here 
that a high level of interest in scientific investigation may first be 
developed. 

Effectiveness of Instruction : 
Data , Analysis , and Interpretation 



The formative evaluation progreim was designee^ to secure answers 
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to the questions proposed in Table 1. The conclusion reached and the 
judgments made in this section of the report are based on the ratings 
of the material by teachers participating in the program. This part 
of the report is organized according to the eight major objectives of 
Unit I. All of the data that relate to each objective are presented 
and interpreted within the discussion of the objective. These data and 
interpretations are then examined in relation to the questions proposed 
in classroom transactions and outcomes, as presented in Table 1. 

Item analyses, using the FORTAP program/"*" were prepared for both 
experimental and control group pretests and posttests . item data are 
presented immediately following the descriptive data under each objec- 



tive . 



Ob jective 100 . Students will associate foods with generalized 
bodjr needs. Three student activities and other instructional strategies 
were designed to develop student competencies to achieve this objective. 
As this was introductory to the ME NOW program, the developers assumed 
that many students would be able to perform the objective prior to 
instruction. The activities were designed to interest and motivate 
students and to provide them with success in their first e>^erience 
with science learning. 

For activities 1 to 3, 31 percent of the teachers reported that 

they used the prescribed strategies as described; 63 percent reported 

some modifications. All teachers reported that the strategies were 

successful. They suggested that the student worksheets for graphing 

height and weight, though revised as recommended after the 1970-71 

Frank B. Baker and T. J. Martin. Fortap ; A Fortran Test Analysis 
Package. Laboratory of Experimental Design, Wisconsin Research and 

T:rnn Development Center for Cognitive Learning, The University of Wiscon- 

CI\1L sin, March 1, 1968. 
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testing, need further revision — the height chart should be numbered 
in inches and the weight chart needs to go beyond 150 pounds and should 
be labeled with pounds and ounces. 



Interest 



Pleasure 



Willingness 



Percent of 
teachers 
(N:^16) 



100 



50 



Disinterest 


Displeasure 


Unwillingness 


5U 




56 


lii 


lii 


111 



5 = high 
3 = neutral 
1 = low 
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Figure 2. Reaction of the majority of students 
to activities 1 to 3 

Figure 2 shows that teachers found student reactions to be 

12 

markedly high across three rating scales. Activities 1 and 2 were 
considered to be more important than activity 3, but the general 
judgment esqjressed was that the activities as a group were important 
(see Figure 3) . 

100 



Percent 50 




I 



5 4 3 2 1 
Important • OK * Useless 



Percent of 
teachers 
(N=13) 



Figure 3. Importance to students of activities 1 to 3 
Student performance with respect to objective 100 was assessed by 
items on the pretest and posttest and by teacher ratings of student 



performance and the importance of the siabobjectives of objective 100 



14 



12. 
13 



14 



See Appendix II for a copy of the Teacher Feedback Questionnaire. 

The number of the experimental teachers (N=16) rating each of the eight 
subobjectives ranged from 14 to 16. The total percent may exceed or be 
less than 100 percent due to rounding error. 

See Appendix III for a list of objectives and siabob jectives. 
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Figure 4 shows the proportions of students in the class who were 
able to perfoiTO the behaviors specified by the eight subobjectives. 
Teachers considered the subobjectives for this activity important (Figure 
5) and indicated that most students performed the specified behaviors 
during instruction. 

100 r . 



50 - 48 



All 3 i. 1 1 None 
4 2 4 4 



I 



Percent of 
teachers 
(N=15) 



50 




Figure 4. Proportion of 
students able to perform 
on subobjectives of ob- 
jective 100 



3. !_ 

5 4 3 2 1 
Important OK ^ Useless 

Figure 5. Importance of the 
subobjectives 



Four item pairs were designed to sample achievement on this 
objective. 



if YOU goIjg to go on a space \^\p 
That wol'lo last fo"' lay^ and 2ay: -hLh 
Of The::? .^old r.-j.; •'\}'.v 

AN X ON That PICTo-^t 



j iOC 




*f Mi^'i 3C:'v. K dl Ci - T-;: 
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Gains were made by both the experimental and control groups on 
item pair 1-A, 10-B which was judged to function at the cognitive level 
of knowledge (see Table 6). The gain for the control group can be 
accounted for by a shift, in Form A, from selecting boots, and by a 
shift, in Form B, from selecting music. The gloves in item 10-B 
registered a slight gain. The biserial correlations showed significant 
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Table 6, item Responses and Biserial Correlations 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M* 0* 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A"l 
B-10 


79 
87 


20 5 41 33 1 0 
47 3 5 45 0 0 


87 
79 


1 9 43 £7 0 0 
62 0 1 37 0 0 


.13 
.31 


• 32 
.65 


Control 


A-1 
B-10 


80 
L8 


10 11 31 48 0 0 
22 1 0 26 0 0 


88 
80 


2 8 25 65 0 0 
62 1 1 35 0 0 


.57 
• 62 


• 37 

• 40 



O represents omissions; underlined percentages indicate correct response. 

Table 7. Pretest to Posttest Changes* 
(The response choice for A-1 is cited first.) 



Item Pair A-1, b-10 



Student 
Group 



Experi- 
mental 

Control 



Correct 
Choice 



D+A 



+14 +15 +14 
+17 -10 +3 



Percent Change, Pretest to Posttest 



Parallel Distractor Pairs 



B A+B 



-19 
^8 



"3 -10 
0 -3 



B 



B+D 



+4 -8 

-3 +9 



-4 

+2 



C+C 



+2 -4 
-6 +1 



*This table will be included for every item pair and should be read 
as, for example, 14 percent more of the experimental group selected 
response D in item A-1 on the posttest as compared to the pretest. 

improvement from pretest to posttest in the experimental group^ After 
instruction, 43 percent of the experimental group students selected 
response C, the chair, in Form A and 37 percent selected response 
the gloves, in Form B^ The small control group gain can be attributed 
to a loss in selecting music on the posttest • 

The artwork on item response C, Form A, should be revised to 
appear more like the chair in Form B. Also, the gloves in item response 
D, Form B, should be modified to look more like space gloves • Teachers 
suggested that the hamburger, choice D in item 1-A, could be improved^ 
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Item paix 21-A, 1-B was judged to function at the cognitive level 
of knowledge and to provide data to be grouped with baseline items to 
provide a profile of entry- level behaviors for a class group. Base- 
line data items are considered to be useful for establishing a point of 
reference for individuals and groups but to be of less value in providing 
information on the achievement of students as a result of the instruction 
program* 

Although a net gain of four percent (see Table 9) was achieved by 
the ea^erimental group, sor^ confusion was evident within forms. There 
was a loss of 12 percent on Form A, which can be attributed to a shift 
to response C, heavy exercise. On Form B there was a gain of 20 percent, 
which can be accounted for by a shift from choice D, heavy exercise. 
Rest (choice A) was also a strong distractor in Form B. The same 
general response pattern exists for the control group, although the 
posttest biserial correlation was positive and higher for the 21-A, 
1"B control group than for the similar experimental group. 

These data on the item pairs seem to indicate that there was some 
difficulty on the part of the EMH students in distinguishing which is 
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Table 8. Item Responses and Biserial Correlations 



Student 
Group 


Item 

# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
raental 


A-21 
B-1 


79 
87 


78 3 16 3 0 0 
20 0 51 29 1 0 


87 
79 


66 3 26 4 0 0 
18 0 71 10 0 0 


.47 
.02 


-.02 
.34 


Control 


A-21 
B-1 


80 
88 


69 3 29 0 0 0 
31 1 59 8 1 0 


CO o 
CO 00 


72 2 23 2 1 0 
21 1 62 14 1 0 


.2? 
.24 


. 34 
.39 



Table 9. Pretest to Posttest Changes 



Item Pa 


^ _ i^Aucu 

ir A-21, B-1 Percent Chanae. Prf^tf^sh m Pn^t-t-oe*. 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A C A+C 


B A B+A 


C B C+B 


D D D+D 


Experi- 
mental 

Control 

—J 


-12 +20 +4 
+3 +4 +4 


0 -2 -2 
-1 -10 -7 


+10 0 +6 
-6 0 -1 


+1 -19 -10 

+2 +6 +4 
— 1 



most important - food, rest or exercise. A probable explanation is 
that health and physical education teachers have been stressing the 
importance of rest and exercise and the ME NOW materials are simply 
adding one more item to the list of important things to do. It may be 
that the EMH student is n ,t capable of making these rank order distinc- 
tions, although gains of 14 and 12 percent, respectively, were rade on 
the identical items in the previous evaluation study. 

We recommend that this item be left in the test to help teachers 
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identify students who have not been able to rank order the importance 
of food, rest and exercise in relation to growth needs. The problems 
of teaching for these distinctions should be pointed out in the revised 
Teacher's Guide * 

Item pair 4-A, 5-B was judged to provide baseline data and to 
function at the cognitive level of comprehension • Table 10 indicates 
that both experimental and control classes made gains on this item pair, 
and biserial correlations indicate that: ais pair of items is dis- 
criminating well bet-ween students who achieved a high score on the test 
and students who achieved low scores. Teachers suggested that the stem 
be changed to read, "Which person is as tall as this line on the graph 
of height?" The second and third bars in the height graph on Form A 
should be transposed to avoid giving position as a clue to the correct 
response. 




Table 10. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 4 
E-5 


79 
87 


13 77 4 1 5 0 
1 3 11 83 1 0 


87 
79 


13 80 3 0 3 0 
0 2 11 84 3 0 


.62 
.63 


.64 
.81 


Control 


A-^ 
B-5 


80 
88 


11 69 lO 1 8 1 
1 1 15 75 8 0 


88 
80 


7 81 6 1 6 0 
1 0 9 88 3 0 


.39 
.31 


.67 
.62 
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Table 11. Pretest to Posttest Changes 
(The response choice for A-4 is cited firsts) 



Item Pair B-5 Percent Change, Pretest to Posttest 



otudent 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B D B+D 


A B A+B 


C C C+C 


D A D+A 


Experi- 
mental 

Control 


+3 +1 +2 
+ 12 +13 +12 


0-10 
"4 -1 -2 


-1 0 -1 
-4 -6 -6 


"1 -1 -1 

0 0 0 



This item pair and the next item pair to be discussed (12-A, 20-B) 
were included to determine whether students could interpret graphical 
data. Students seem to have difficulty with graphing activities. "''^ 
At the briefing session, experimental group teachers felt that students 
would not be able to respond to these items. The high initial success 
pf students on these items (see Tables 10 and 12) provides evidence for 
the necessity to eitpirically verify such judgments. Lack of knowledge 
of instruction in the control classes makes an explanation of the marked 
gains on this item pair impossible. Instruction in the graphing 
activities did not change posttest results in tht experimental group 
(see Table 11) . 

Item pair 12-A, 20-B was judged to provide baseline data and to 
function at the cognitive level of comprehension. Data from this and 
the previous item pair cleprly indicate that students in the experi- 
mental and control groups can successfully transfer data presented in 
graph form to figures, and vice versa, before instruction. 
See Robinson and Tolman, p. 78. 
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Table 12. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Itom 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-12 
B-20 


79 
87 


72 15 1 4 8 0 
21 63 6 5 3 2 


87 
79 


77 16 4 0 2 0 
13 72 8 3 4 0 


.59 

.56 


• 28 
.65 


Control 


A-12 
B-20 


80 
88 


66 10 4 11 8 1 
19 70 3 5 2 0 


88 
80 


84 7 1 6 2 0 
14 74 4 3 5 1 


.61 
.53 


.70 
.38 



Teachers requested that this stem be changed to read, "Which line 
on the graph is the same as the weight of the person on the scale?" 
They also suggested that instructions in all items of this type be 
changed to read, "Mark an X on the line that touches that part." This 
seems much clearer and avoids lengthy sentences that may be confusing 
to the EMH student. Since control group gains were greater than those 
of the experimental group, gains cannot be attributed to the effect of 
instruction. The biserial correlations were high for both the experi- 
mental and control groups. 

The initial success of students with the two item pairs on graph 
reading indicates that graphical communication can be used in instruc- 
tion when such communication would be useful. 
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Table 13. Pretest to Posttest Changes 
(The response choice for A-12 is cited first.) 



Item Pa 


ir A-12, B--20 Percent Change, Pretest to Posttest- 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A B A+B 


B A B+A 


C C C+C 


D D D+D 


Experi- 
mental 

Control 


+5 +9 +8 
+18 +4 +11 


+ 1 -8 -3 
"3 -5 -5 


+3 +2 +2 
-3 +1 -1 


-4 -2 -4 
-5 -2 -3 



Objective 101 . Students will associate food types with plant 
and animal sources . Four student activities and other instructional 
strategies were designed to develop student: competencies to achieve 
this objective, similar to objective 100, the developers assumed 
that some students would be familiar with the content of this objective 
prior to instruction. 

Fifty-six percent of the teachers reported that they used the pre- 
scribed strategies as described; 44 percent reported some modifications. 
All teachers reported that the strategies were successful. No problems 
with materials were encountered, although many students initially 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 

Percent of 
teachers 50 
(N=16) 



"li. i«. 

543215432154321 



5 = high 
3 = neutral 
1 = low 



Figure 6. Reaction of the majority of students 
to activities 4 to 7 
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thought that the food items came from the store; they did not associate 
food with plants or animals. 

Figure 6 shows that student reactions were very high across the 
three ratina scales. Activities 5, 6 and 7 were more important than 
activity 4, but (see Figure 7), all activities were considered important 
for EMH children. Eighty-one percent of the teachers estimated that 
three-fourths or more of their students were able to perform the be- 
haviors specified by the subob jecti ves and they judged the subob jectives 
to be very important (Figures 8 and 9) . 



100 



59 



Percent 




Percent of 
teachers 
(N=15) 



5 4 3 2 1 



Important 



OK 



Useless 



Figure 7. Importance to students of activities 4 to 7 
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Percent of 
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All 1 i i <i None 
4 2 4 4 



5 4 3 2 1 



Important 



OK 



Useless 



Figure 8. Proportion of 
students able to perform 
on subobjectives of 



Figure 9. Importance of the 
subobjectives 



objective 101 



Two item pairs were designed to sample achievement on this 
objective . 
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Item pair 8-A, 2-B was judgeo to provide baseline data for this 
objective and to function at the cogritive level of knowledge. Item 
8"A required the selection of one animal-source food from three plant- 
source foods, and item 2-B required the selection of one plant-sourct 
food from three animal-source foods. Althouah a high success rate 
(91 percent) was achieved on the pretest by the experimental group, 
gains were still recorded on the posttest (97 percent). The biserial 
correlations remain very high despite the high success rate. Since 
control group gains were also high (from 91 to 98 percent) we cannot 
conclude that ea^erimental group gains on this item pair were attribut- 
able to the effect of instruction. 



14* Item Responses and Eiserial Correlations 
for Experiment al and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N. 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 8 
B-2 


79 
87 


0 2 96 1 0 0 
87 6 6 1 0 0 


37 
79 


1 0 99 0 0 0 
95 1 4 0 0 0 


.59 
.49 


• 51 
.67 


Control 


A- 8 
B-2 


80 
88 


0 6 91 3 0 0 
91 3 3 2 0 0 


00 00 


0 197110 
98 0 3000 


.49 
• 49 


.47 
.57 
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Table 15. Pretest to Posttest Changes 
(The response choice for A-8 is cited first.) 



Item Pair B-2 



Student 
Group 



Correct 
Choice 



C+A 



Percent Change^ Pretest to Posttest 



Parallel Distractor Pairs 



B 



A+B 



B 



B+C 



D+D 



Experi- 
mental 

Control 



+3 +8 +6 
+6 +7 +6 



+1 -5 -2 
0 -3 -2 



-2 -2 -2 
-5 0 -2 



-1 -1 -1 
-2 -2 -1 



ERLC 



A BEAH cms FROM 
WHAT PART Of A PUNT'> 

AN X ON TMC LJNE 
THAT TOyCHCS THAT PAPT 




A SAuISH COflfS FROM 
^HAT PflPl OF A PLANTS 

"a?" tu I TA The ^IHI 
^•hAT IC'J''iiS, THAT PART, 




Item pair 18-A/ 8-B provides baseline data for this objective 
and functions at the cognitive level of comprehension. A net loss of 
three percent was achieved across forms in the experimental group. 
Although the stylized plant illustration was used in instruction, it 
is possible that some students may not be familiar with beans and 
radishes. The more general explanation would be that EMH students may 
not be able to associate vegetables not used in instruction with the 
parts of the stylized plant. This item pair could be revised to 
include vegetables used during instruction, though this would reduce 
the cognitive level to recall. On the other hand, the biserial cor- 
relations are very good, indicating one other possibility ~ that the 
students who scored low on the test are having difficulty associating 
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vegetables not used in instruction with the parts of the stylized 
plant and that higher scoring students can make this association. 
Instructions on how to involve slower students could remedy this problem. 
Teachers should be encouraged to plant seeds and grow the plants in the 
classroom so that students can see the edible portions in relation to 
the whole plant. Also, wherever possible, entire plants should be 
purchased and brought into the classroom instead of merely the edible 
portions. The revised edition of the Teacher's Guide contains a 
suggested field trip to the supermarket. 



Table 16. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-18 
B-8 


79 
87 


70 6 0 24 0 0 
28 8 3 60 1 0 


87 
79 


62 2 8 28 0 0 
22 11 5 62 0 0 


.53 
.34 


.53 
.54 


Control 


A-18 
B"8 


80 
88 


51 6 1 41 0 0 
23 2 3 69 2 0 


CO o 
CO CO 


42, 7 1 49 1 0 
40 6 0 54 0 0 


.25 
.23 


.29 
-.09 



Table 17. Pretest to Posttest Changes 
(The response choice for A-18 is cited first.) 



Item Pa 


ir A-18, B-8 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A D A+D 


B B B+B 


C C C+C 


D A D+A 


Experi- 
mental 

Control 


-8 +2 -3 
-9 -15 -12 


-4 +3 -1 
+1 +4 +3 


+8 +2 +6 
0 -3 -1 


+4 -6 -1 
+8 +17 +13 
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Objective 102 . Students will distinguish different ^ in physical 
ch ar ac t e r i s t i cs of foods . Two student activities were designed to 
develop student competencies to achieve this objective. 

Fifty-six percent of the teachers reported that they used the 
prescribed strategies; 44 percent reported some modifications. All 
teachers reported that the strategies were successful. One teacher's 
conunent was very noteworthy — "I will admit I thought the wording and 
strategies were poor on this unit, until I tried it. I used them 
exactly, though, and they were highly successful/' One teacher indicated 
that the pliers-type juicer was difficult to locate, and several teachers 
noted a reluctance on the part of some students to taste baby food. 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 
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81 


75 


75 








Percent of 
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Figure 10. Reaction of the majority of students 
to activities 8 and 9 



Figure 10 shows that student reactions were very high across the 
three rating scales. Both activities are important for EMH children 
(Figure 11) . 

Figure 12 shows the proportion of students who were able to per- 
form the behaviors specified by the one subobjective of objective 102. 
Sixty-one percent of the teachers indicated that three-fourths or 
more of their students were able to perform these behaviors. Ninety- 
one percent indicated that over half had performed successfully. 
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Student success in the activities of objective 102 was moderately 
high. This was measured by teacher judgment, no test items were used. 
The subobjective was also rated as very important by the teachers 
(see Figure 13) . 
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Figure 11. Importance to students 
of activities 8 and 9 
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Figure 12. Proportion of 
students able to perform 
on the svibobjective of 
objective 102 
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Figure 13. Importance of the 
subobjective 



Objective 103 . Students will relate structure with fianction of 
mouth parts . six student activities and other instructional strategies 
were designed to develop student competencies to achieve this objective. 
The writers assumed that the students wpuld not be familiar with the 
subject matter under this and subsequent objectives. 

Sixty-three percent of the teachers used the strategies as described? 
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37 percent reported son;e modification. All teachers reported that the 
strategies were successful and no problems with materials were encountered. 
Many of the students knew some of the functions of the teeth and tongue, 
but not all. No students were familiar with the role of saliva in 
swallowing and digestion. 
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Disinterest Displeasure Unwillingness 
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Figure 14. Reaction of the majority of students 
to activities 10 to 15 

Figure 14 shows that student reactions were very high across the 

three rating scales. All activities were judged to be important, 

with activity 11 (Function of the Tongue) judged most important for 

EMH children (see Figure 15) . 
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Figure 15. Importance to students of activities 10 to 15 
Figure 16 shows the proportion of students who were able to per- 
form the behaviors specified by the four subobjectives of objective 103. 
Seventy-one percent of the teachers estimated that three-fourths or 
more of their students were able to perform the behaviors. 
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They felt these subobjectives were very iirportant (Figure 17) . 
100 , , 100 
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Figure 16. Proportion of 
students able to perform 
on subobjectives of 
objective 103 
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Figure 17. Importance of the 
subobjectives 



Five item pairs were designed to sainple achievement on this 
objective. 



rtiAT 'S FC/^'^ "^l*-: ^.SLIVA "'OZJ lift 



GRAVEL 



fHAT IS FOOD riXED WITH 3"UVfl rOST LIH^ 
M&pt(. A*i X OH YcuP Choice 



GPAVEL 



SAND 



Item pair 3-A, 24-B functions at the cognitive level of analysis 
and was designed to determine if students could compare food-saliva 
mixtures with other materials of similar consistency. A net gain of 
27 percent was achieved across both Forms A and B in the experimental 
grov^), indicating that significant learning occurred during instruction. 
The biserial correlation increased from pretest to posttest for Form B, 
but decreased for Form A. However, .28 for Form A is still acceptable 
and indicates a good discriminating item. 

Teachers were nearly unanimous in wanting to include the four 
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response choices in the stem of the item because some students could 
not read the words. In the future, all response choices should be 
included in the stem and read to the class. 



Table 18. Item Responses and Biseriai Correlations 
for Experiment al and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 3 
B-24 


79 
87 


9 24. 33 34 0 0 
32 29^ 29 8 1 1 


87 
79 


1 43 30 26 0 0 
14 67 14 4 1 0 


.56 
.40 


.28 
.60 


Control 


A- 3 
B-24 


O 00 
00 00 


10 26 30 31 3 0 
25 35 30 9 1 0 


00 00 
O 00 


2 32^ 31 35 0 0 
18 48 24 10 1 0 


.61 
.42 


.46 
.42 



Table 19. Pretest to Posttest Changes 
(The response choice for A-3 is cited first.) 



Item Pair A-3, B-24 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B B B+B 


A D A+D 


C C C+C 


D A D+A 


Experi- 
mental 

Control 


+19 +38 +27 
+6 +13 +9 


-8 -4 -6 
-8 +1 -3 


-3 -15 -9 
+1 -6 -2 


-8 -18 -13 
+4 -7 -1 



Item pair 5-A, 7-B provides baseline information for this objective 

WHAT PART IS BEST FOR GPINDING (CHEWING) 
FOOD l«TO LITTLC PltCES' 

flABX AN X \H TM£ CI»CL£ ON TmE Lilt 
That TOUCMCi Tm£ ^AftT. 



''t«<r A-, IS 'TNt rlftCLE ON Tnf ^1 
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and functions at the cognitive level of knowledge. Both experimental 
and control groups showed net gains from pretest to posttest. The net 
change of 17 percent across forms in the experimental group clearly 
shews that learning is talking place as a result of instruction. The 
biserial correlations on the posttest (.56 and .91 for Forms A and B, 
respectively) indicate that this pair of item^ is functioning well in 
discriminating between students with low and those with high posttest 



scores. 



Table 20, Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 5 
B"7 


79 
87 


1 22 4 72 0 1 
3 20 7 69 1 0 


87 
79 


3 7 3 86 0 0 
0 6 5 89 0 0 


. j2 
.52 


.56 
.91 


Control 


A" 5 
B"7 


80 
88 


3 25 1 71 0 0 
2 16 5 75 2 0 


88 
80 


2 15 8 75 0 0 
0 14 8 0 0 


.43 
.46 


.45 
.09 



Table 21. Pretest to Posttest Changes 
(The response choice for A-5 is cited first.) 



Item Pair A-5, B-7 



Student 
Group 


Correct 
Choice 




Parallel Di 


<^'tractor 


Pairs 






D D D+D 


A 


A A+A 


B 


B 


B+B 


C 


C 


C+C 


Experi- 
mental 


+14 +20 +17 


+2 


-3 0 


-15 


-14 


-14 


~1 


-2 


-2 


Control 

1 


+4 +4 +4 


-1 


-2 -1 


-10 


-2 


-5 


+ 7 


+ 3 


+5 



Item pair 13-A, 4-B functions at the cognitive level of knowledge. 
This item pair showed a significant improvement in student gain from 
pretest to posttest for the experimental group, but there was a net 
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4-B 




loss on this item pair for the control group. The gain of 21 percent 
in the experimental group can be attributed to a response shift from 
the intestine to the correct choice, the mouth. However, Table 22 
shows that 26 percent of the experimental group still chose the stomach 
after instruction. The actual beginning point of digestion should 
receive more enphasis in the instructional mater als. The biserial 



Table 22. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-13 
B-4 


79 
87 


18 25 29 28 0 0 
8 20 38 32 1 0 


87 
79 


17 7 29 47 0 0 
3 23 19 56 0 0 


.21 
.03 


.24 
48 


Control 


A-13 
B-4 


80 
88 


10 23 34 21 1 0 
3 38 34 25 0 0 


88 
80 


14 26 38 22 1 0 
5 40 24 31 0 0 


.46 
.21 


.01 
.57 



Table 23. Pretest to Posttest Changes 
(The response choice for A-13 is cited first.) 



Item Pair A-13, B-4 Percent. Change, Pretest to Posttest 



Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D D D+D 


A A A+A 


B C B+C 


C B C+B 


Experi- 
mental 

Control 


+19 +24 +21 
-11 +6 -3 


-1 -5 -3 
+4 +2 +4 


-18 -19 -19 
+3 -10 -4 


0 +3 +2 
+4 +2 +3 
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correlations for Forms A and B of .24 and .48, respectively, indicate 
that the items are good discriminators. 




A mean gain of 37 percent from pretest to posttest was achieved 
by the experimental group on item pair 20-A, 9-B. This result can be 
accounted for by shifts from all three distractor pairs. The control 



group registered no gains on this item pair. The cognitive level of thi 
pair of items is knowledge, and, based on an experimental-control group 
comparison, it is evident that substantial student gains were made in 
the experimental group as a result of instruction (see Table 25). 



Table 24. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-20 
B-9 


79 
87 


14 37 18 32 0 0 
5 23 31 40 1 0 


87 
79 


7 7 16 70 0 0 

8 10 3 77 0 0 


.41 
.42 


.81 
.59 


Control 


A-20 
B"9 


80 
88 


11 31 28 30^ 0 0 
8 20 36 35 0 0 


88 
80 


23 26 20 30 0 0 
10 21 34 35 0 0 


.67 
.20 


.61 
.57 
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Table 25. Pretest to Posttest Changes 
(The response choice for A-20 is cited first*) 



Item Pair A-20, B-9 


Percent Change, Pretest 


to Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Distractor 


Pairs 




D D D+D 


A 


A A+A 


B 


C 


B+C 


C B 


C+B 


Experi- 
mental 


+ 38 +37 +37 


-7 


+3 -2 


"30 


-28 


-29 


-2 -13 


-8 


Control 


0 0 0 


+12 


+2 +8 


-5 


-2 


-4 


-8 +1 


-4 



Item pair 24-A, 17-B provides baseline information on this objec- 
tive and functions at the cognitive level of knowledge. Although pre- 
test means were high for this item pair, a mean gain of 11 percent 
(80 to 91 percent) was achieved by the experimental group. Interest- 
ingly, a comparison of this item pair with 5-A, 7-B would indicate 

HHAT 'part pushes FOOD AROUND 2a-a WHAT PA^l MO.'f: FOOL Vil i^-f 




that students were initially more knowledgeable about the function of 
the teeth than that of the tongue. Here again, this probably reflects 
the emphasis given to oral hygiene in most EMH cxasses. A mean gain of 
two percent (from 85 to 87 percent) was achieved by the control group. 
Although pretest means for the control group were higher than for the 
experimental group, the pretest to posttest mean gain was much higher 
for the experimental group than for the control group, indicating that 
instruction did have an effect in the experimental group. 
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Table 26. item Responses and Biserial Correlations 
for E:q?eriinental and Control Groups 



Student 
Group 



Itepi 
# 



Experi- 
mental 



A-24 
B-17 



Control 



A-24 
B-17 



Pretest 



N 



79 
87 



80 
88 



Percent of N 



A B C D M O 



8 3 89 1 0 0 
8 6 72 13 1 0 



8 3 8£ 5 1 0 
5 5 85 5 0 1 



Posttest 



N 



87 
79 



88 
80 



Percent of N 



B C D M O 



0 6 ga 3 

4 1 91 4 



0 0 
0 0 



6 2 85 6 1 0 
1 4 90 5 0 0 



Pre 



.09 

.69 



.65 
.44 



Table 2 7. Pretest to Posttest changes 
(The response choice for A-24 is cited first.) 



Item Pa. 


Lr A-24r B-17 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C C C+C 


A A A+A 


B B B+B 


D D D+D 


Experi- 
mental 

Control 


+ 2 +19 +11 
+1 +5 +2 


-8 -4 -6 
-2 - "2 


+3 -5 -1 
-i -1 -1 


+2 -9 -4 
+1 0 +1 



Objective 104. Student re]^ ]^c^ 

fun£ti£n £f the esophacrus. Two student activities and other instruc- 
tional strategies were designed to develop student competencies to 
achieve this objective. The writers assumed that very few student, 
would be familiar with the content of this objective prior to instruc- 



tion. 



seventy-five percent of the teachers usaci the strategies as 
described; 25 percent reported some modification. All reported that 
the strategies were successful, some difficulties were encountered 
with the X-ray film that depicts chewing and shallowing, but this was 
expected since the film was not designed for use with this program. 
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A new series of films specifically for use with ME NOW will eliminate 
the problems encountered with substitute films during experimental 
trials. 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 
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Figure 18. Reaction of the majority of students 
to activities 16 and 17 

Figure 18 shows that student reactions were high across the 

three rating scales, although not as high as for previous activities. 

Figure 19 shows that both activities were judged important for EMH 

students. 
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Figure 19. Importcince to students of activities 16 and 17 
Figure 20 shows the proportion of students who were able to per- 
form the behaviors specified by the two sijbobjectives of objective 104. 
Seventy-one percent of the teachers estimated that three- fourths or 
more of their students were able to perform these behaviors. Although 
this percentage is identical to that for objective 103, more teachers 
(40 percent) indicated that all of their students could successfully 
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Figure 20. Proportion of 
students able to perform 
on subobjectives of 
objective 104 
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Figure 21. Importance of the 
subobjectives 



perform the desired behaviors. Figure 21 shows that teachers judged 
the subobjectives to be important. 



One pair of test items was designed to sample achievement 
on this objective. 



MriAT PART IS m ESOPHAGUS 0« FOOD TUEf 

flAtK AH X IH TmC cJftCL-. O** TmC ;.IN£ 

That touches that »a«>t.^ 




-'■'M -APT IS M ESOPHAGij: OP FOOj TUfcf^ 




Item pair 17-A, 21-B functions at the cognitive level of knowledge. 
A mean gain of 48 percent from pretest to posttest was achieved by the 
experimental group. There was no mean gain for the control group, indi- 
cating that the large experimental group gain can be attributed to in- 
struction. The gain can be accounted for by losses in all three distrac- 
tor response pairs. The biserial correlations indicate that the items 
are good discriminators. 
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Table 28. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


r 




A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 17 
B-21 


79 
87 


30 39 23 6 1 0 
40 23 29 8 0 0 


87 
79 


79 14 5 2 0 0 
87 6 3 4 0 0 


.54 
.50 


.68 
.48 


Control 


A-17 
B-21 


80 
88 


34 33 20 14 0 0 
3£ 36 22 10 2 0 


88 

so 


2£ 44 23 5 2 0 
39 31 23 8 0 0 


.29 
.50 


.29 
.29 



Table 29. Pretest to Posttest Changes 
(The response choice for A-17 is cited first.) 



Item Pair A-17/ B-21 


Percent Chcinge, Pretest to 


Posttest 




Student 


Correct 
Choice 


Parallel Distractor Pairs 


Group 


A A A+A 


B B B+B 


c c c+c 


D D 


D+D 


Experi- 
mental 


+49 +47 +48 


-25 -17 -21 


-18 -26 -22 


-4 -4 


-4 


Control 


-8 +9 0 


+11 -5 +3 


+3 -1 +2 


-9 -2 


-5 



Objective 105 . Students will relate stomach functions to diges- 
tion . Ten student activities and other instructional strategies were 
designed to develop student competencies to achieve this objective. 

Two problems were identified in the sequence of activities that 
led to modification of the materials. First, most teachers could not 
locate stethoscopes and using styrofoam cups with the bottoms removed 
proved unsatisfactory. Stethoscopes will be included in the kit in the 
future. Second/ students were confusing the starch and sugar tests 
which were conducted on the same day using one worksheet. One teacher 
separated the experiments by one day and used separate worksheets with 
excellent results. The materials were revised to include this procedure 

ERIC 
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ERIC 



and separate worksheets were constructed. 

Nearly half of the teachers reported that their most reticent 
students "suddenly became excited cind were deeply involved with this 
series of activities," Other teachers reported that, much to their 
surprise, many students were able to work individually on starch and 
sugar tests. Another surprising result was that many students were 
familiar with the terms "dissolve" and "solution" and had elementary 
definitions of these concepts within their grasp. 

Because of the large number of activities under this objective, 
several graphs were constructed for small subgroups of activities. 
Figure 22 displays the graphs of teachers' ratings of student interest 
across the series of activities, and Figures 23 and 24 display the 
graphs of student pleasure and willingness, respectively, xhe re- 
sponses for activities 21 to 23 and 24 were especially high, 
inn Interest - Disinterest 
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Figure 22. Interest of the majority of students 
in activities 18 to 2 7 
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Figure 23. Pleasure of the majority of students 
in activities 18 to 2 7 
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Figure 24. Willingness of the majority of students 
to participate in activities 18 to 27 

Figure 25 shows that the teachers judged this series of activities 
to be important. Figure 26 shows the proportion of students who were 
able to perform the behaviors specified by the nine subobjectives of 
objective 105. 
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Figure 25. Importance to students of activities 18 to 2 7 
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Figure 26. Proportion of students able to 
perform on subobjectives of objective 105 
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The range of teachers estimating that three-fourths or more of 
their students were able to perform the behaviors specified is from a 
high of 80 percent for activities 25 to 27 to a low of 61 percent for 
activity 24, In view of the complexity of the tasks, we are very 
pleased with the results. The range of teachers estimating the ratio 
of successful students at one-half or more is from a high of 95 percent 
for activities 21 to 23 to a low of 81 percent for activity 24. Teacher 
judgment of the importance of the subobjectives was generally quite 
high (see Figure 27) . 
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Figure 27. Iitportance of the sijbob jectives 
of objective 105 

Two of the test teachers experienced some difficulties with this 
series of activities, which resulted in some of the low teacher ratings. 
Based on their difficulties, modifications were made in procedures, 
worksheets and in the activities. 

Six item pairs were designed to sample achievement on objective 105. 

SUGAP T[^.T COUJTIOfi IS THIS COIOd I 1 *>-x SUGAP TEST SOlDTlON IS THIS COLOR. | 1 

mii SUGAR TtST S0lbTIOf< IS USED ON A FOOD., WHEN SUGAR ^ ST SOLUTION IS US£D 0« A fOOD., 

WHICH COLOR SHOWS THAT S\j^i(^P r, PPi'^iUV WHICH COLOR ShOWS THAT SUGAR IS PmtHV 

*N y CN The TElT TUlt Of vnyP CMCICE. AN X ON TMfc TEST TUBE 0^ VQUft CHOICE. 



YELLOv* 



Bl*ck 



Yellow 



Dlue 
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Item pair 18-B functions at the cognitive level of compre-- 

hension. Mean net gain for the experimental group from pretest to post- 
test was 51 percent (from 10 to 61 percent), A shift from blue and white 
to yellow as the correct choice accounted for this gain, A mean net 
gain of ten percent was achieved by the experimental group for black, 
choice B in Forms A and B, as a response choice. Some students probably 
confused the >-esults of the starch and sugar tests. The biserial 
correlations indicate that the items are good discriminators, A mean 
net loss of one percent in the control group indicates that zhe experi- 
mental group gains can be attributed to the effect of instruction. 

The stem should be revised to read, "Sugar test solution is blue/' 
and eliminate possible confusion by not having color in the test item 
booklet. The word "blue" was written in the test book for all posttests. 

Table 30, item Respon5;es and Biserial Correlations 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-6 
B-18 


79 
87 


30 11 4 54 0 0 
49 3 16 30 1 0 


87 
79 


20 20 54 7 0 0 
4 14 68 14 0 0 


-.25 
.04 


.48 
.41 


Control 


A-6 
B-18 


80 
88 


34 9 6_ 50 1 0 
40 13 13 32 3 0 


88 
80 


30 13 8 50 0 0 
51 5 1£ 34 0 0 


-.33 
-.14 


-.12 
-.06 



Table 31. Pretest to Posttest Changes 



Item Pair 


A"6; B-18 


Percent Change, 


Pretest 


to Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C C C+C 


A 


D A+D 


B 


B 


B+B 


D 


A 


D+A 


Experi- 
mental 


+50 +52 +51 


-10 


-16 -13 


+9 


+11 


+10 


-47 


-45 


-45 


Control 


+2 -3 -1 


-4 


+2 +3 


+4 


-8 


-2 


0 


+ 11 


+5 
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Item pair 9-A/ 6-B functions at the cognitive level of analysis. 
The mean net gain of 25 percent (from 45 to 70 percent) in the experi- 
mental group can be accounted for by net losses from all distractor 
pairs. Although there was a mean net gain of 14 percent from pretest 
to posttest in the control group, we feel that the 25 percent gain in 
the experimental group can be attributed to the effect of instruction. 
Boys scored higher than girls on item 9-A while girls scored higher 
than boys on item 6-B. 



Table 32. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-9 
B-6 


79 
87 


6]^ 29 4 6 0 0 
40 15 30 14 1 0 


87 
79 


77 21 0 2 0 0 
14 4 62 19 0 0 


.41 
.54 


.66 
.48 


Control 


A" 9 
B"6 


80 
88 


60 24 4 13 0 0 
36 15 32 16 0 0 


88 
80 


70 13 3 11 2 0 
29 11 50 10 0 0 


.41 
.28 


.48 
.65 



Table 33, Pretest to Posttest Changes 
(The response choice for A-9 is cited first.) 



Item Pair A-9/ B-6 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A C A+C 


B D B+D 


C A C+A 


D B D+B 


Experi- 
mental 

Control 


+16 +33 +25 
+ 10 +17 +14 


-8 +5 -1 
-11 -6 -8 


-4 -26 -16 
-1 -7 -4 


-4 -11 -8 
-2 -4 -3 
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Interviews with students identified varying degrees of under- 
standing of the concept measured by the item* Students choosing the 
pickup truck or tank truck chose them because they "carried things 
like the stomach carries food." Students choosing tne dump truck 
reasoned that it "carried things and diamped them like the stomach 
does with food." The carrying, mixing and dumping processes of the 
cement truck were clearly explained as being cinalogous to stomach 
action by students choosing this response. 

Teachers' comments indicate that the art work on the tank truck 
should be improved and the "What object" should be replaced by "Which 
truck" in the stem of Form A. 




Item pair 11-A, 19-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest for the experimental group was 
17 percent (from 45 to 62 percent). This gain can be attributed to 
losses in the response choices for the large cind small intestines. 
There was a mean net gain of eight percent (from 14 to 22 percent) for 
the esophagus as a distractor. It nay be necessary to add instructions 
to the Teacher's Guide to help the students differentiate between the 
esophagus and the stomach. It is also possible that some students 
think digestive juices are added in the esophagus. Teachers should be 
alerted to this possible problem. 

ERLC 
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There was a mean net gain of six percent from pretest to posttest 
in the control group. The larger pretest to posttest gain in the 
experimental group indicates that student success in the experimental 
group is attributable to the effects of instruction. The biserial 
correlations indicate that the items are good discriminators. The 
instructions in the stem should be changed to "Mark an X on the line...," 
and the figure should be changed to correspond with the other figures 
in the test. 



Table 34. Item Responses and Biserial Correlations 
for Experimental a nd Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


1 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-11 
B-19 


79 
87 


5 16 29 49 0 0 
23 20 14 41 2 0 


87 
79 


22 5 10 62^ 1 0 

23 8 8 62 0 0 


.03 
.15 


.34 
.55 


Control 


A-11 
B-19 


O CO 
CO CO 


8 15 46 31 0 0 
18 23 18 40_ 1 0 


CO o 
CO CO 


iO 11 30 47 2 0 
18 18 29 36_ 0 0 


.26 
.39 


.51 
.36 



Table 35. Pretest to Posttest Changes 
(The response choice for A-11 is cited first.) 



Item Pair A-ll, B-19 Percent Change, Pretest to Posttest 


Stude.it 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D D D-l-D 


A A A+A . 


B C B+C 


C B C+B 


Experi- 
mental 

Control 


+13 +21 +17 
+16 -4 +6 


+17 0 +8 
+2 0 +1 


-11 -6 -9 
-4 +11 +3 


"19 -12 -15 
-16 -5 -10 



LOOK AT THE SCREEN NOW, WHICH 

COLOR SHOWS STARCH'' 

Mark an X in that- part of tmE 

SCJARE ON rOUR PAPER 




22-* LOOK AT T-t SCREEN f.O.^, WHtCf' 

COLO" S-ewS SIARCri'' 




With item pair 22-A, 11-B functioning at the cognitive level of 
conprehension, a mean net gain from pretest to posttest of 53 percent 
(from 14 to 67 percent) in the experimentr 1 group can be accounted for 
by a shift from choosing brown and white. There was a mean net gain of 
four pe-::ent in choosing blue in the experimental group. Some students 
may have problems distinguishing between blue and black in the projected 
slide. This indica'-es that yellow, a color obtained with the sugar test 
solution, could be a possible distractor instead of blue. Also, since 
no squares appear in the test paper, the instructioix in the stem should 
read, "Mark an X on your choice." Since the mean net gain from pretest 
to posttest in the control group was only seven percent (from eight to 
15 percent) , the large gains achieved by the experimental group can be 
attributed to the effect of instruction. 



Table 36. r+-em Responses and Biserial Correlations 
for ExperirriGntal and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-22 
B-11 


79 
87 


6 11 19 63 0 0 
8 54 21 1£ 1 0 


87 
79 


13 68 17 2 0 0 
5 5 ?4 66 0 0 


.07 
-.24 


.54 
.28 


Control 


A-22 
B-11 


80 
88 


31 8 19 41 1 0 
15 60 15 _8 2 0 


88 
80 


27 16_ 14 42 1 0 
10 53 25 12 0 0 


-.11 
.60 


.16 
-.18 
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Table 37. Pretest to Posttest Changes 
(The response choice for A-22 is cited first.) 



Item Pair h-22, B-U Percent Change, Pretest to Posttest 



Student 
Group 



Experi- 
mental 

Control 



Correct 
Choice 



B 



B+D 



+57 +50 +53 
+8 +5 +7 



Parallel Distractor Pairs 



A+C 



+7 +3 +4 
-4 +10 +3 



-2 
-5 



C+i 



-3 -2 
-5 -5 



-61 -49 -55 
+1 -7 -4 



Item pair 2 3-A, 16-B provides baseline information and functions 
at the cognitive level of comprehension. The pretest results on this 



THE UKIV. -.£LOW Wt^t FOOL IS YOuP BODY 

WHICH wob'j ?t I'^o: gl:tl.' 




item pair, for both the experimental and control groups, indicate that, 
prior to instruction, the majority of these populations understands that 
pieces of food become smaller during the digestion process. There is 
some indication, however, that the word "most" has caused students to 
choose the correct response on the pretest. The me in net gain from 
pretest to posttest in the experimental group was l^. percent (from 74 
to 88 percent), accounted for by a shift from all distractor pairs. 
The mean net gain from pretest to posttest in the control group was six 
percent (from 81 to 87 percent). The control pretest mean on this item 
pair was higher than the mean for the experimental group; but the mean 
net gain in the experimental group, that we attribute to instruction, 
was greater than the mean net gain of the control group. 
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Table 38. Item Responses and Biserial Correlations 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent cf N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-23 
B-16 


79 
87 


9 82 5 4 0 0 
10 67 6 17 0 0 


87 
79 


8 86^ 2 3 0 0 
1 90 4 5 0 0 


.62 
.51 


.85 
.62 


Control 


A"23 
B-16 


80 
88 


4 88 3 5 1 0 
3 75 5 17 0 0 


88 
80 


2 92 2 1 2 0 
4 83 8 5 1 0 


.31 
.32 


.61 
.47 



Table 39. Pretest to Posttest Changes 
(The response choice for A-23 is cited first.) 



Item Pair A-23, B-16 


Percent Change, Pretest to 


Posttest 




Student 


Correct 
Choice 




Parallel 


Distractor Pairs 




Group 


B B B+B 


A 


D A+D 


C 


A C+A 


D C 


D+C 


Experi- 
mental 


+4 +23 +14 


-1 


"12 


-3 


-9 -6 


-1 -2 


-2 


Control 


+4 +8 +6 


-2 


-12 -8 


-1 


+1 0 


-4 +3 


-1 



WHICH PICTURE SHOWS TM[ PKCi 
. .000 MOST DISSOIVIU^ 

flA«K AN X ON VOUP rMOICl 



o O 



o 
o 



o " 
00 o 

o 



OF FOOD m' T [jissnivf*-' 



o 



O 



oo o 
o 



O 



Item pair 29-A, 30-B provides baseline information and functions 
at the cognitive level of comprehension. The high pretest scores on 
this item pair were surprising to the BSCS staff, but there is some 
indication that the word "most" may act as a clue, as with the previous 
item pair. During staff visits to the experimental group classrooms, 
students were interviewed and asked why they chose their particular re- 
sponse choice for this item pair. The term "dissolve" was associated by 
the EMH students with terms such as "melt," "disappear," and "goes away," 
indicating an elementary level of understanding of the dissolving process, 
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Table 4C. Item Responses and Biserial Correlations 
for Experimental cuid Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Ea^eri- 
mental 


A-29 
B-30 


79 
87 


8 3 0 89 1 0 
7 11 75 6 0 0 


87 
79 


3 3 3 90 0 0 
0 4 94^ 1 1 0 


.39 
.43 


.69 
.64 


Control 


A-29 
B-30 


80 
88 


5 4 3 86 1 0 

5 5 80 8 3 0 


88 
80 


3 3 2 90 1 0 
0 5 90. 3 0 0 


.18 
.36 


.54 
.09 



Table 41. Pretest to Posttest Changes 
(The response choice for A-29 is cited first.) 



Item Pair A-29, B-30 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D C D+C 


A B A+B 


B D B+D 


C A C+A 


Experi- 
mental 

Control 


+1 +19 +10 
+4 +11 +7 


-5 -7 -7 
-2 0 -1 


0 -5 -3 
-1 -5 -3 


+ 3 -7 -2 
-1 -5 -3 



The mean net gain in the experimental group of ten percent (from 
82 to 92 percent) was greater than the mean net gain of seven percent 
(from 83 to 90 percent) by the control group. However, since differences 
between the two groiios are so small, experimental group gains cannot be 
attributed to instruction. In spite of the high success rate in the 
experimental group, the biserial correlations indicate that the items 
are good discriminators. 

Objective 106 . Students will infer functions of parts of the 
circulatory system . Eleven student activities and other instructional 
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strategies were designed to develop student competencies to achieve this 
objective. Sixty percent of the teachers used the strategies as de- 
scribed, 34 percent reported some modification and six percent reported 
much modification. All teachers who followed the prescribed strategies 
reported them successful. Teacher feedback indicated that many of the 
students were familiar with the terms "heart," "vessel" and "pulse," but 
that the exact nature of the circulatory system was not well known. 

The major problem with the materials was the inability of some 
teachers to assemble the heart model and make it work properly. This 
problem will be overcome by the functioning torso. The "hands-on" 
philosophy of the program has been extremely successful in this series 
of activities, as evidenced by only one of many comments we received: 
"The model of the circulatory system has been one of the most fascinat- 
ing, attention getting and keeping devices of the program so far. The 
boys love it! By allowing them to experiment in their free time with 
the model they have discovered much of the things about circulation on 
their own. This device aided even my slowest one in discussing the 
questions freely and in a knowledgeable manner." 

Three feedback forms were used to collect teacher data across 
activities 28 to 38. Figures 28 to 30 show the high level of response 

for student interest, pleasure and willingness. 

Interest - Disinterest 



Percent of 
teachers 
(N=16) 



100 
50 



63 


63 








53 


111 








sly 


11 



5 = high 
3 = neutral 
1 = low 



543215432154321 

Act. 28-31 Act. 32-34 opt. Act. 35-38 
Figure 28. Interest of the majority of students 
in activities 28 to 38 
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Percent of 
teachers 
(N=16) 



Pleasure - Displeasure 



100 



50 . 




5 4 



215432154321 



Act. 28-31 Act. 32-34 opt. Act. 35-38 
Figure 29. Pleasure of the majority of students 
in activities 28 to 38 



5 = high 
3 = neutral 
1 = low 



Percent of 
teachers 
(N=16) 



100 



50 " 



Willingness - Unwillingness 




5 = 
H 3 = 
1 



high 

neutral 

low 



543215432154321 
Act. 28-31 Act. 32-34 opt. Act. 35-38 

Figure 30. Willingness of the majority of students 
to participate in activities 28 to 38 

Most teachers felt the activities under objective 106 were impor- 
tant for their students. One teacher, however, felt that her students 
already knew the relationship between heartbeat a.id pulse and marked 
this series of activities as unimportant for her students. Two teachers 
felt that the optional activity 34 was not necessary and marked it as 
not being useful (see Figure 31) . 
100 



Percent of 
teachers 
(N=15) 




5 = important 

3 = OK 

1 = useless 



54321543215432 J. 
Act. 28-31 Act. 32-34 opt. Act. 35-38 
Figure 31. Importance to students of activities 28 tc 38 
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Figure 32 shows the proportion of students who were able to per- 
form the behaviors specified by the six svibob jectives of objective 106. 



100 



Percent of 
teachers 
(N=15) 





5; 






46 




- 42 




16 




23 


33 


g B 2_ 




26 I 


23 

[ ^ 2_ 



All Ik i <i 0 All 2 i i <i 0 All 2 1 1 <i 0 
4244 424 "^4 424 "^4 



Act. 28-31 



Act. 32-34 opt. 



Act. 35-38 



Figure 32. Proportion of students able to perform 
on subobjectives of objective 106 

The range of teachers estimating that three-fourths or more of 
their students experienced success in performing the desired behaviors 
in this series was from a maximum of 75 percent for activities 32 to 
34 optional to a low of 69 percent for the remaining activities. The 
percentage estimating that one-half or more of their students success- 
fully performed the desired behaviors was 93 percent for activities 
28 to 31 and 92 percent for activities 32 to 34 optional and 35 to 38. 

The percentage of teachers rating this series of subobjectives as 
important was quite high. The ratings of the teachers who escperienced 
problems also stand out clearly (see Figure 33) . 

100 



Percent of 
teachers 
(N=15) 



50 




5 = important 

3 = OK 

1 = useless 



Figure 33. 



543215432154321 

Act. 28-31 Act. 32-34 opt. Act. 35-38 
iFj^ortance of the subobjectives of objective 106 
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Five item pairs were designed to sample achievement on this 
objective. 




Item pair 2-A, 15-B provides achievement data for this objective 
and functions at the cognitive level of knowledge. Mean net gain from 
pretest to posttest for the experimental group was 2 3 percent (from 69 
to 92 percent). Since there was a mean net loss of 16 percent (from 
71 to 55 percent) in the control group, we conclude that the experi- 
mental group qains were due to the effect of instruction. The biserial 



Table 42. luem Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent af N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-2 
B-15 


79 
87 


13 16 66 5 0 0 
72 3 7 16 0 0 


87 
79 


2 7 89 2 0 0 
95 1 1 3 0 0 


.41 
.64 


.76 
.50 


Control 


A-2 
B-15 


80 
88 


8 9 66 15 3 0 
76 6 5 14 0 0 


88 
80 


9 8 62 15 1 0 
43 44 5 9 0 0 


.61 
.28 


.41 
.52 



Table 43. Pretest to Posttest Changes 
(The response choice for A-2 is cited first.) 



Item Pair A-2, B-15 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C A C+A 


A D A+D 


B C B+C 


D B D+B 


Experi- 
mental 

Control 


+23 +23 +23 
+1 -23 -16 


-11 -13 -13 
+1 ' -5 -2 


-9 -6 -7 

-1 0 0 


-3 -2 -2 
0 +38 +19 
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correlations indicate that the items are good discriminators. The 
instructions in the stem should be changed to "Mark an X on the line..." 




Item pair 12-B provides baseline information for this objec- 

tive and functions at the cognitive level of comprehension. The mean 
net gain from pretest to posttest for the experimental group was three 
percent (from 79 to 82 percent) and the control group showed a mean 
net loss of two percent (from 71 to 69 percent) . Although the experi- 
mental group gain attributable to the effect of instruction was small, 
the response pattern for the distractors yields valuable information. 
A total of 14 percent of the experimental group chose the pulse site 
at the wrist as causing pulse beat, after instruction. A possible 
vocabulary problem may be present in this item. The stem should be 
changed to "Which part makes the pulse beat," thus enabling the staff 
to determine if the word "cause" is the source of the problem. The 



Table 44. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi-^ 
mental 


A-7 
B-12 


79 
87 


13 1 81 4 0 1 
0 20 7£ 2 0 0 


87 
79 


11 2 84 1 1 0 
1 18 80 1 0 0 


.39 
.22 


.64 
.34 


Control 


A-7 
B-12 


80 
88 


13 0 80 6 1 0 
5 27 63 5 1 0 


88 
80 


30 2 64 5 0 0 
1 23 75 0 1 0 


.41 
-.08 


-.13 
.20 
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Table 45. Pretest to Posttest Changes 
(The response choice for A-7 is cited first.) 



Item Pa. 


Lr B-12 Percent Chanqe, Pretest to Pn.c;f t-P.c^f 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


c c C+C 


A B A+B 


B A B+A 


D D D+D 


Experi- 
mental 

Control 


+3 +2 +3 
-16 +12 -2 


-2 -2 "3 
+17 -4 +7 


+1 +1 +2 
+2 -4 -1 


"3 -1 -2 
-1 -5 -2 



biserial correlations indicate that the items are reasonable discrim- 
inators . 






p!jL>: t.-Ai: >cju Tr,L=' ^ :f -t f^Ar t,v; ..^^^ 

0 0 0 0 0' 

Item pair 10-A, 3-B functions at the cognitive level of application. 
Mean net gain from pretest to posttest for the c^erimental group was 
14 percent (from 42 to 56 percent) . There was a mean net loss of nine 
percent (from 46 to 37 percent) in the control group. The experimental 
group gains can be accounted for by a shift from choosing 21 and 11. 
However, the gain of three percent (from 12 to 15 percent ) on 13 indi- 
cates that some students with visual reception problems may not be 
able to discriminate between the 13 and the 15. A reasonable sequence 
of response choices would be 11, 15, 17 and 21. There is clearly an 
effect due to instruction in the experimental group and the biserial 
correlations indicate that the items are excellent discriminators. 
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Table 46. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 10 
B-3 


79 
87 


28 46_ 13 14 0 0 
15 11 3£ 34 1 0 


87 
79 


29 41 22 8 0. 0 
9 8 71 11 0 0 


.31 
.46 


.42 
.52 


Control 


A-10 
B-3 


80 
88 


24 45 18 14 0 0 
10 20 47^ 20 2 0 


88 
80 


16 15 31 16 2 0 
4 29 32 27 1 0 


.57 
.44 


.25 
.69 



Table 47. Pretest to Posttest Changes 
(The response choice for A-10 is cited first.) 



Item Pair A-10, B-3 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A D+A 


Experi- 
mental 

Control 


-5 +33 +14 
-10 -8 -9 


+1 -23 -11 
-8 +7 -1 


+9 -3 +3 
+13 +9 +11 


-6 -6 -7 
+2 -6 -2 



Item pair 16-A, 13-B provides baseline information for this objec- 
tive and functions at the cognitive level of knowledge. Mean net gain 
from pretest to posttest for the experimental group was 12 percent (from 
71 to 83 percent) and mean net gain for the control group was 11 percent 
(from 51 to 62 percent) . Escperimontal groi^) gains are attributable to 
shifts from air and saliva to the correct response, blood. There was 



WHICH OF THESE DOCS THE HEAPT PUMP *^.t WHICH OF THES^ DOES THE HEART PlWs 

AIP. BLOOD, SALIVA, STOMACH JUlCE.s'^ .STOflACH JUICES, SALIVA, BLOOD. AIR'> 

Mark an X on your choke. Mark an X on your choice. 



A|P 




BLOOD 




SALIVA 




STOMACH 
JUICES 




STOMACH 
JUICES 




SALIVA 




BLOOD 




AIR 


A 


6 


c 


0 


A 


I 




c 




D 
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a small gain of two percent (from three to five percent) in choosing 
stomach juices. Since the term "stomach juices" has been changed to 
"digestive juices" in the ME NOW materials, this charge should also be 
made in this item. This inconsistency in terminology could account 
for a somewhat lower gain than was anticipated. 

Pretest to posttest gains are similar in the experimental and 
control groups. However, the higher percentage of students choosing the 
correct response in the experimental group (83 versus 62 percent) , to- 
gether with the large gains in biserial correlations (-26 in both forms) 
for the experimental group, leads us to conclude that there was an 
effect due to instruction measured by this item pair. 



Table 48, Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D *M 0 


Pre 


Post 


Expexi- 
mental 


A-16 
B-13 


79 
87 


16 70 10 '4 0 0 
3 2 72^ 20 2 0 


87 
79 


9 8^ 0 5 1 0 
5 3 80 13 0 0 


,54 
,29 


,80 
.55 


Control 


A-16 
B-13 


80 
88 


25 5£ 5 11 1 0 
7 1 45 44 2 0 


88 
80 


25 52 9 10 2 0 
3 6 71 20 0 0 


,46 
,51 


,49 
.28 



Table 49, Pretest to Posttest Changes 
(The response choice for A-16 is cited first,) 



Item Pai 


.r A-16, B-13 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A D+A 


Experi- 
mental 

Control 


+15 +8 +12 
-5 +16 +11 


-7 -7 -7 
0 +22 +12 


-10 +1 -5 
+4 +5 +5 


+1 +2 +2 
-1 -4 -2 
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IF The pulse beats 15 TIMES. HOH MANY js-a iF THE PULSE BEATS 13 T1«ES. HOW ^'A.JY 

TIMES DID THE HEART BEAP TiHES DI3 THE hl.RT BEAT- 

Hark an X on your choice. Hap< an X on <our chcice 

00O00000 

A B C DAB C J 

Item pair 25-A, 28-B functions at the cognitive level of application 
Mean net gain from pretest to posttest for the experimental group was 
21 percent (from 28 to 49 percent) and can be accounted for by shifts 
from all distractors. However, 33 percent of the experimental group is 
still choosing 15 instead of 13 for the correct response • This result, 
together with the result from item pair 10-A, 3-B, brings us to the 
definite conclusion that many EMH students with visual reception prob- 
lems cannot distinguish between 13 and 15* The sequence of 11, 13, 17 
cind 21 should be used for this item. 

There was a nvean net loss from pretest to posttest for the control 
group of four percent (from 34 to 30 percent). This leads to the con- 
clusion that this item pair measures a definite gain due to the effect 
of instruction. 



Table 50. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-25 
B-28 


79 
87 


14 22 37 16 0 0 
24 43 2£ 9 0 0 


87 
79 


8 43 38 11 0 0 
13 28 56 4 0 0 


.41 
.67 


.50 
.63 


Control 


A-25 
B-28 


80 
88 


15 31 36 18 0 0 
11 32 36 19 1 0 


88 
80 


15 25^ 44 14 2 0 
24 38 35 4 0 0 


.60 
.34 


.32 
.78 
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Table 51. Pretest to Posttest Changes 
(The response choice for A-25 is cited first.) 



Item Pair B-28 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A D+A 


Experi- 
mental 

Control 


+ 10 +32 +21 
-6 -1 -4 


-6 -5 -5 
0 -15 -7 


+1 -15 -7 
+ 8 +6 +7 


-5 -1] -8 
-4 +13 +5 



Objective 107 * Students will infer _a relationship between food 
and blood and describe barriers between them . Three student activities 
and other instructional strategies were designed to develop student 
competencies to achieve this objective. Eighty-one percent of the 
tea^l ;rs u^ed the prescribe^ strategies, 19 percent reported Lome 
modifications. A few minor problemi w?th worksheets were encountered 
and the worksheets have been revised. 

Figure 34 shows that student reactions Vv'era high, but not as 
high as with some previous activities. Some of the activities in th.'s 
series utilize slides and n<^t laboratory equipment. The following 
teacher's comment illustrates the students* reaction, "Activities 
limited to only questions and the sl'^^-^s seemed to have 'turned the 
boys off* somewhac especially when they have tasted the excitement of 
being allowed to totally participate in some of the other activities. 
You. have also made my job that much more challenging in that I must 
keep participation in the ether subject areas equally as interesting 
and challenging." 

Figure 35 shows that the activities were considered important 
for EMH students. 



73 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



Percent of 
teachers 50 |-44 
(N=16) 



All 



--44 44 



IIlJ 



50 



31 

It 



54321543215 



3 2 1 



Figure 34. Reaction of the majority of sti dents 
to activities 39 to 41 



100 



Percent 50 




I 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 
Important OK Useless 

Figure 35. Importance to students of activities 39 to 41 



5 = high 
3 = neutral 
1 = low 



100 



50 



All 2 1 1 .1 None 
4 2 4 4 



I 



100 



50 

Percent of 
teachers 
(N=15) 0 




Figure 36* jr'roportion of 
students able to perform 
on subobject? ves of objec- 
tive 10 7 



2^ 1 

5 4 3 2" 

Important * OK » Useless 

Figure 37. Importance of the 
subobjectives 



Figure 36 shows the proportion of students who were able to perform 
the behaviors specified by the two sxibobjectives of objective 107. 
Forty-eight percent of the teachers reported that three-fourths or 
more of their students could perform the behaviors specified by the 
sxabobjectives. Seventy-eight percent reported that one-half or more 
of their students could perform the ^.pecified behaviors. Figure 37 
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shows that teachers judged the subobjectives to be iirportant. 



Four item pairs were designed to sample achievement on tliis 
objective. 



WHICH OF THE FOLLOWING BECOMES FECE^'. - .-i-a hhICH OF THE FOLLOWING BECOMES FECES'? 

Mark an X cn your Ckoice. r»PK an X on yOur chojce 



BLOOD 




NOK .IGESTED 
FOOD 




WATER 




DIGESTED 
FOOD 




DIGESTED 
FOOD 




WATER 




NON-DIGESTED 
FOOD 




BLOOD 


A 


B 


c 


0 


A 


6 


c 


0 



Item pair 14-A, 22-B functions at the cognitive level of knowledge. 
This item pair was relatively difficult with a mean net gain from pre- 
test to post test of eight percent (from 26 to 34 percent) for the 
experimental group. Almost unaniruously , teachers recommended that the 
response choices be placed in the stem and read to the students. This 
should be changed in the revised items. There was a mean net gain from 
pretest to post test of two percent in the control group. The biserial 
correlations in both Forms A emd B posttests indicate that the items 
are good discriminators. The change in biserial correlations from 



Table r>2. Item Responses amd Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Pe-ucent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-14 
3-22 


79 
87 


22 29 15 33 1 0 
30 21 22 25 1 0 


87 
79 


22 2j4 17 37 0 0 
28 11 44 16 0 0 


.04 
.04 


.33 
.40 


Control 


A-14 
B-22 


80 
83 


14 36 6 43 1 0 
31 25 22 16 1 0 . 


88 
8C 


16 25 19 39 1 0 
21 16 41 21 0 0 


.19 
.05 


.28 
.10 
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Table 53- Pretest to Posttest Changes 
(The response choice for A-14 is cited first.) 



Item Pair A-14, E-22 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A D^a 


Experi- 
mental 

Control 


-5 +21 +8 
-9 +14 +2 


0 -9 -5 
+2 +5 +3 


+2 -10 -4 
+ 13 -9 +2 


+4 -2 +2 
-4 -10 -7 



pretest to posttest in the experimental group indicates a significant 
change attributable to instruction. 



WHICH flATtRlAL CAN B£ FOUND IN BLOOD 
SALIVA.. STARCH. SUGAR. STOJIACh JUICt'^ 

ttA«K AN X ON VOUft CHOICE. 



StjCAiJ sum. "AlIVA, STOMACH JSJICi^' 

HlSk AN X f % T'Ui,P CH'jifE , 



SALIVA 



STARCH 



SUGAP 



STOr.ACH 
JUKF 



i/^LlVA 



:T0^^ACH ililLf 



Item pair 26-A, 26-B fianctions at the cognitive level of knowledge. 
There was a net loss from pretest to posttest of five percent (from 38 
to 33 percent) in the experimental group, which is accounted for by 
shifts to choosing starch and stomach juice. Two possible problems are 
identified here. First, the conversion of starch to sugar during 
digestion needs to be more explicit in the experiments conducted by the 
students. By svibstituting diabetic crackers that contain no sugar and 
give a positive starch test, it will be possible to show more clearly 
the conversion of starch to* sugar. The crackers that were used during 
instruction yielded positive sugar and starch tests prior to digestion, 
tnus making any conclusion concerning starch-to-sugar conversion very 
nebulous and difficult. The second problem concerns the use of the term 



76 



Table 54. item Responses and Biserial Correlations 



for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-26 
B-26 


79 
87 


11 6 37 46 0 0 
38 16 24 22 0 0 


87 
79 


20 16 2£ 37 0 0 
39^ 14 10 37 0 0 


-.06 
-46 


-57 
.72 


Control 


A-26 
B-26 


O CO 
CO CO 


16 15 35 34 0 0 
51 8 17 23 1 0 


CO o 

1 CO CO 


13 14 38 35 1 0 
41 11 15 33 0 0 


-38 
.45 


• 33 
.40 



"stomach juice." This has now been changed to "digesti-^e juice" in the 
ME NOW materials and this same change should be made here. 

There was also a mean net loss from pretest to posttest of four 
percent in the control group. From the response data alone it appears 
that this item did not measure any significant effect due to instruction. 
However, an examination of the biserial correlations indicates a strong 
improvement in the experimental group and a decline in the control 
group. This leads to the conclusion that this item pair did measure 
an effect due to instruction in the experimental group. 



Table 55. Pretest to Posttest Changes 
(T? i response choice for A-26 is cited first.) 



Item Pair A'26, B-26 Percent C hange, Pretest to Posttest 



Student 
Group 

Experi- 
mental 

Control 



Correct 
Choice 



C+A 



-9 +1 
+3 -10 



-5 
-4 



Parallel Distractor Pairs 



A+C 



+9 -14 -3 
-3 -2 -3 



B 



B B-^B 



flO -2 +4 
-1 +3 . +2 



D+D 



-9 +15 +3 
+1 +10 +6 
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Item pair 27-A/ 29-B functions at the cognitive level of applica- 
tion. The mean net gain from pretest to posttest of 21 percent (from 



WHitH PIECES OF FOOD ARt nOST RLADY TO 
GO INTO TH£ BLOOD'' 
Hapk an X ON vojR CHcrrt. 




t'^ICH PlfCLS OF FOOD Ahl MOST RIADY TO 
INTO TH[ BLOOD'' 

WaOK an X ON YOUR C»^01CE. 




61 to 82 percent) in the experimental group can be attributed to shifts 
to the correct response from all distractors. There was a mean net 
gain of eight percent (from 57 to 65 percent) in the control group. 
This result leads to the conclusion that this item pair measures an 



Table 56. item Responses and Biserial Correlations 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-27 
B-29 


79 
87 


3 13 18 66 1 0 
10 56 21 9 2 0 


87 
79 


3 5 7 84 1 0 
6 80 9 5 0 0 


.63 
.64 


.86 
.85 


Control 


A-27 
B-29 


80 
88 


8 14 24 54 1 0 

9 60 17 10 3 0 


00 o 
00 00 


7 6 10 75 2 0 
14 54 28 5 0 0 


.32 
.67 


.52 
.29 



Table 57. Pretest to Posttest Changes 
(The response choice for A-27 is cited first.) 



Item Pair A-27, B-29 Percent Change, Pretest to Posttes 



Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D B D+B 


A A A+A 


B C B+C 


C D C+D 


Experi- 
mental 

Control 


+18 +24 +21 
+21 -6 +8 


0 -4 -3 
-1 +5 +1 


-8 -12 -10 
-a +11 +1 


-11 -4 -7 
-14 -5 -9 



erJc 
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increase in learning due to the effect of instruction. Student inter- 
views confirmed this conclusion, A typical response was, "Since I 
can't see anything in blood, pieces of food must be awfully small if 
they are there." The biserial correlations for the experimental group 
are exceptionally strong, 

SUGAR !N THE BLOOD !N YOUR TOE HAS 
SUGAR IN YOUR AR« WAS ONCE A PART OF jb-a ONCE A PART OF HEART, BREAD STOMACH. 

BLOOD VI SSEL, STOflACH,, HEART. CRACKER. x BLOODVESSEL. 

KaRk an ON YOUR CHOICE. NaRK AN X ON VOUR CmOIC£. 

BLOOD VESSEL STOHACH HEART CRACKER MEAPT SLICE Of B^^LAC STOf^ACH BLOOL' VESbtL 

A » C b 

Item pair 28-A, 14-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 11 percent (from 19 to 30 percent), and for the control group 
there was a mean net loss of four percent (from 25 to 21 percent) , The 
biserial correlations for the e^q^erimental group were more uniform than 
were those obtained for the control group, and also indicated that the 
items are reasonably good discriminators. However, the entire resiDonse 
pattern reflects some confiasion, even though there was a shift fron 
choosing the blood and stomach to choosing the cracker. After instruc- 
tion in the e^q^erimental group, '^l percent chose the blood vessel, 
15 percent chose the stomach, and 18 percent chose the heart. If one 
considers the item in a "Gestalt" view, any of the four choices would 
be correct, since the sugar in the arm was once inside of the blood 
vessels, heart and stomach. Although the item dcas reflect growth due 
to instruction, it should either be revised or discarded, since the 
apparent confiision is considered to be attributable to ths item and 
probcU-iy not to instruction. 
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Table 58. Item Responses and Biserial Correlations 



for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


_ ..Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-28 
B-14 


79 
87 


29 27 18 27 0 0 
16 1£ 18 53 1 0 


87 
79 


41 8 16 34 0 0 
20 25^ 22 33 0 0 


.09 
.58 


.32 
.39 


Control 


A-28 
B-14 


80 
88 


34 13 16 36 0 0 
22 14 11 53 0 0 


88 
80 


41 23 16 19 1 0 
16 24 15 45 0 0 


.29 
.32 


-.04 
.54 



Table 59. Pretest to Posttest Changes 
(The response choice for A-28 is cited first.) 



Item Pair A-28, b-14 Percent Change, Pretest to Posttest 



Student 
Group 



Experi- 
mental 

Control 



Correct 
Choice 



B D+B 



+7 +14 +11 
-17 +10 -4 



Parallel Distractor Pairs 



A+D 



+12 -20 -4 
+ 7 "8 -1 



B 



B+C 



-19 +4 -7 
+10 +4 +7 



C+A 



-2 +4 +1 
0 -6 -3 



Objective 108 . Students will observe and describe movement of 
solutions through membrane barrierj. Three student activities and other 
instructional strategies were designed to develop student competencies 
to achieve this oi^jective. Fifty percent of the teaci.ars used the 
strategies as described, 4 percent reported scane modification. S^me 
teachers e:q)erienced difficulties in oi -ning the collodion ttabing even 
though they had practiced this during the training session in Boulder. 
Consequently, instructions on how to open the tuning were included in 
the revised materials. 

Figure 38 shows that student attitudes were very high for this 
series of activities. Tv'o typical comments from teachers were, "Once 

ERIC 
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the color change began to take place in the smaller tube, the eyes 
of ten young men practically popped out of their heads," "Wowi! My 
usual deadheads were so excited and motivated, I had told them the 
day before that some magic happens in our intestines 'but,' I said, 
•you won't believe me if I tell you so you'll have to wait and see, 



Percent of 
_ teachers 



(N=16) 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



5 = high 
3 = neutral 
1 = low 



53 60 60 

:liiLJiJyL 

543215432154321 

Figure 38. Reaction of the majority of students 
to activities 42 to 44 

Figure 39 shows that the activities are important for EMH students. 



100 



Percent 50 



64 

liJ 



I 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 
Important OK ^ Useless 

Figure 39, Importance to students of activities 42 to 44 
Figure 40 shows the proportion of students able to perform the 
behaviors specified by the three sijbobjectives of ob:;wCtive 108, 
Sixty-six percent of the teachers estimated that three-fourths or more 
of their students could perform the specified behaviors, 88 percent 
indicated that one-half or more of their st^'ients could perform the 



100 



50 




I 



Percent of 
teachers 
(N=15) 



100 



50 



All 3 1 1 .1 None 
4 2 4 4 



71 

1 

■ 22 



Figure 40. Proportion of 
students able to perform 
on subobjectives of 
objective 108 



5 4 3 2 1 
Important OK ■ ■ Useless 

Figure 41, licportance of the 
subobjectives 



specified behaviors. Figure 41 shows the very high importance rating 
given to these subobjectives by the teachers. 



Three pairs of test items were designed to assess student achieve- 
ment on this objective. 



WrtlC'i PiCICfi SHOi Pitas Of FOOD \H 
SOLUTIOfi PASSING ThPO'j^" A ^f1J2AM'> 
fUft^k AM X OH tmC cnnkia ^ ict jh. 








Item pair 15-A, 25-B provides baseline data for this objecti,re 
and functions at the cognitive level of comprehension. This item pair 
gives a good clue concerning the ability of mentally handicapped stu- 
dents to relate a word description to specific pictures. Mean net gain 
from pretest to posttest was four percent (from 68 to 72 percent) for 
the control group. The biserial correlations on the posttest were highe 
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Table 60. Item Responses and Biserial Correlations 



Student 
Group 


Item 
# 


Pretest 


Post test 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A-15 
B-25 


79 
87 


4 11 9 76 0 0 
11 15 60 11 1 1 


87 
79 


13 15 2 70_ 0 0 
6 8 75 11 0 0 


.47 
.43 


.57 
.51 


Control 


A-15 
B-25 


80 
88 


11 9 10 70 0 0 
16 14 5£ 14 1 0 


88 
80 


6 14 ]4 66^ 1 0 
11 8 6£ 18 0 0 


.11 
.36 


.43 
.35 



for the experimental grov?) than for the control group, but the items 
were good discriminatoro in both groups. Little effect, if any at all, 
can be attributed to instruction on this item pair. Iitproviii^ the 
artwork by usinq an opaque membrane may help improve this item pair. 



Tahle 61. Pretest to Posttest Changes 
(The response choice for A-15 is cited first.) 


Item Pa 


ir A-15, B-25 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D C D+C 


A D A+D 


B A B+A 


C B C+B 


Experi- 
mental 

Control 


-6 +1S +4 
-4 +8 +2 


+9 0 +4 
-5 +4 -1 


+4 -5 0 

+5 -5 u i 


-7 -7 -7 
+4 -6 -1 



Ite-fl pair 19-A, 23-B provides baseline infcrmation for tnis objec- 
tive and functions at che cognitive level of appj. .cation. Mean net 



WHICH MILL DISSavE \S WAT£P AND FOfifl 
A 5OLUT|0N'> 

H*»»t Af» X 0*1 ¥0U# CHClft. 



SALT 



POPCORN 



k'HICH w!Ll DISSOLVE IN wATtP A«D FOPf" 
A SOLmiON'* 



WOOD 



RC'kS 



SALT 



PfAKiJTS 



PINS 
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Table 62. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Ea^eri- 
mental 


A- 19 
B-23 


79 
87 


10 75 11 4 0 0 
7 72 11 8 1 0 


87 
79 


7 83 8 2 0 0 
1 86^ 9 4 0 0 


.52 
.35 


• 45 
.50 


Control 


A- 19 
B-21 


80 
88 


9 6£ 14 9 1 1 
8 73. 14 3 2 0 


88 
80 


3 76^ 16 2 2 0 

4 81^ 9 5 1 0 


.30 
.58 


.56 
.51 



gain from pretest to posttest was 11 percent (from 73 to 84 percent) 
for the experimental group and eight percent (from 70 to 78 percent) 
for the control group. The biserial correlations were high for both 
groups, indicating that the items are goo' discriminators. These 
results indicate that no effect due to instruction is measured by this 
item pair. Prior student knowledge about the meaning of the word 
"dissolve," however, could enable the students to deduce the correct 
response without instruction. Teachers* comments suggest that higher 
gains would be achieved if the response choice were read to the 
students. This change should be made. 



Table 63. Pretest to Posttest Changes 
(The response choice for A-19 is cited first.) 



Item Pa 


ir A-19, B-23 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor P/-iirs 


B B B+B 


A A A+A 


c c c+c 


D D D4 


Experi- 
mental 

Control 


+8 +14 +11 
+10 +8 +8 


-3 -6 -4 
-6 -4 -5 


-3 -3 
+2 -5 -1 


-2 -4 -3 

-7 +2 -3 



84 




Item pair SO-A, 27-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 16 percent (from 49 to 65 percent). For the control group, 
this was two percent (from 51 to 53 percent). The gain for the experi- 
mental group can be accounted for by shifts from all distractors to the 
correct response. These results indicate that this item pair is meas- 
uring an effect attributable to instruction. The biserial correlations 



Table 64. Item Responses and Biserial Correlations 
for Experimental and Control Grot^s 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C 0 M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


A- 30 
B-2 7 


79 
87 


9 29 56 5 0 0 
24 43 26 6 0 1 


87 
79 


14 21 62 3 0 0 
6 68 23 1 1 0 


.32 
• 30 


• 35 

• 55 


Concrol 


A- 30 
B-27 


60 
88 


9 34 5£ 6 0 0 
11 52 30 6 1 0 


88 
80 


11 32 52 2 2 0 
14 54 28 5 0 0 


.31 
• 33 


.21 
• 27 



Tc±)le 65. Pretest to Posttest Changes 
(The response choice for A-30 is cited first.) 



Item Pair A- 30, B"27 Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choi ce 


Parallel Distractor Pairs 


C B C+B 


A A A+A 


B C B+C 


D D D+D 


Experi- 
mental 

Control 


+6 +25 +16 
+2 +2 +2 


+5 -18 -7 
+2 +3 +2 


-8 -3 -5 
-2 -2 -2 


-2 -5 -4 
-4 -1 -3 



85 



indicate that the items are good discriminators. The instructions in 
the stem should be changed to "Mark an X on tne line..." 

Objective Achievement Tests 

Descriptive Data and Interpretation . Pretests were administered 
to experimental classes between November 1 and 7, 1970 and to control 
classes between November S and December 4, 197C. some minor corrections, 
mostly concerning colors, were made in the test slides between pretest 
and posttest administrations. 

Differences in the amount of class time spent per activity and 
in the amount of time devoted to science instruction each week caused 
a wide difference in administration dates within the experimental 
group. The earliest was January 4, 1971 and the latest was March 1, 
1971. Control group posttests were administered between January 7 and 
20, 1971, 

Raw score frequency distributions on the tests for both experi- 
mental and control groups are shown in Table 66. Tables 67 and 68 
provide more detailed descriptive data on pretest and posttest scores 
and on residual gain scores, calculated by u«5ing the raw regression 
coefficie-^t for the combined experimental and control classes. The 
interpretations that follow are based upon the data provided in these 
tables. 

1. Students using Forms A and B in the experimental classes had 

similar pretest means, well within the standard error of measure- 
men of the instruments. 
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Table 66, Frequency Distribution of Raw Scores for 
Test Forms A and Experimental and Control Groups 



Experimental Groups 


Control Groups 


Raw 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Scores 


A 


B 


B 


A 


A 


B 


B 


A 


30 


















28-29 




8 




2 










26-27 




9 


1 


7 




2 


1 




24-25 


4 


16 




8 


3 


3 


1 




22-23 


3 


9 


2 


17 


5 


3 


1 


5 


20-21 


7 


10 


8 


25 


5 


9 


7 


10 


18-19 


18 


12 


14 


9 


10 


13 


21 


16 


16-17 


19 


7 


17 


4 


21 


17 


15 


21 


14-15 


9 


3 


17 


4 


12 


20 


18 


16 


12-13 


16 


1 


14 


3 


13 


9 


9 


9 


10-11 


3 


2 


5 


7 


8 


4 


12 


5 


8-9 




1 


6 




2 




3 


2 


6-7 




1 


2 


1 


1 








4-5 






1 










1 


2-3 


















0-1 


















Totals 


79 


79 


87 


87 


80 


80 


88 


88 



2. Students using test Forms A and B in the experimental classes had 
similar posttest means. The unadjusted posttest means were well 
within the standard error of measurement of the instruments. 
Posttest reliabilities were above the minimum acceptable level 
of .70. Fourteen of 16 experimental classes showed positive mean 
residual gain scores. The negative mean residual gain scores 
were not seriously low. A multiple stepwise regression to deter- 
mine tbe effects of independent variables on posttest scores was 
performed. Examination of the multiple regression output to 



87 



ERIC 



Id 



fl5 

•H 

W 



4J 
W 
0) 

0) 

B 

O 
M 
O 



•8 



88 



ERIC 



as 



u 
s 



Q 
Id 



U 

2 



8 



00 
VD 

H 

•S 



S CO 



6S 

0 



determine the most influential variable (s) was followed by an 
analysis of covariance to determine if there were significant 
differences between classes on posttest scores, with the pretest 
score held as a covariate. An analysis of variances on residual 
gain scores was also performed to confirm the results of the 
analysis of covariance. 
3. Students using Forms A and B in the control classes had similar 
pretest means, well within the standard error of measurement of 
the instrximents. The control group posttest scores, as well as 
the pretest- to-posttest gain, were all within the standard error 
of measurement. The control group classes, then, did not change 
their performance from pretesting to posttesting. A one-way 
analysis of variance was computed on residual gain scores to 
determine if a significant difference existed between the e3cperi- 
mental and control groups. 

Multiple Stepwise Regression Analysis 

Experimental Group , Unit I^. To determine the effect on posttest 
scores, if any, of the independent variables, the following question 
was investigated: "Is there a significant difference in the level of 
achievement on the posttest among students in EMH classes having 
different background variables?" 

The following independent variables were used to test this 
question: sex, age, WISC Full Scale IQ, race, teacher's assessment 
of reading achievement, teacher's assessment of verbal participation, 
time elapsed between pretest and posttest, and pretest score. Since 
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Forms A and B are parallel forms, all student scores were pooled and 
treated as the results of one test. 

The test statistic used in testing the question is the F-statistic 
generated for each independent variable in the last step of the multiple 
stepwise regression: 




where 3^ represents the weight of the independent variable (slope 
of the regression line) . 

represents the standard error of the weight of the 
independent variable. 
The results for the posttest administered to the 166 students in 
the Unit I experimental group are summarized in Table 69. 



Table 69. Results of Multiple Linear Regression Analysis , 
Ea^erimertal Group, Unit I. N = 166 



Independent Variable 




se. 


F 


Sex 




-0.6619 


0.6130 


1.1659 


Age 




0.0464 


0.0194 


5.7548* 


Wise Total IQ 




0.1205 


0.0365 


10.9084** 


Race 




-0.0483 


0.4525 


0.0114 


Reading 




0.2563 


0.2398 


1.1426 


Achievement 






Verbal 




0.3729 


0.2558 


2.1247 


Participation 






Pretest 




0.6576 


0.0833 


62.3910** 


Time 




0.1636 


0.1457 


1.2612 


^Significant at 
♦♦Significant at 


the 
the 


.025 level, 
.001 level, 


^.025(1,157) " ^-^^ 

F r^r^^ /^ 1 c -7 ^ * 10.83 

.001(1,1575 
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The F-value for each independent variable determines the level 
at which that variable is a significant predictor of a score on the 
posttest instrument. 

Discussion 

The data indicate that sex, race, teacher's assessment of reading 
achievement and verbal participation, and time elapsed between adminis- 
tration of pretest and posttest are not significant predictors of 
success on the posttest. The pretest and WISC Total IQ, however, are 
highly significant predictors of success on the posttest {P<.001). Age 
is also a significant pradictor of success on the posttest {P>.025). 
These results indicate that prior knowledge of the concepts measured by 
the test instrument and WISC Full Scale scores were the best determi- 
nants of whether or not the experimental group students attained high 
scores on the posttest. Test analysis shows that 13 of the 30 items 
were aimed at baseline information and that 16 of the 30 items involved 
cognitive levels higher than factual recall. With 43 percent of the 
items aimed at baseline information, the high predictive value of the 
pretest is not surprising, in the Spring, 1970 testing, the pretest 
was also a significant predictor of success {P<.01), but age and WISC 
Full Scale IQ were not. The inclusion of age and WISC Full Scale IQ 
as significant predictors of posttest scores on the 1970-71 test in- 
struments can probably be accounted for by the fact that 16 of the 30 
items involve higher cognitive levels, it seems reasonable to assume 
that the more intelligent and/or slightly older students would be able 
to function better at these higher cognitive levels than less intelligent 
and/or younger students. An analysis of variance based on a 3x3 factorial 
design was performed on residual gain scores to investigate this inference. 
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Table 70. Matrix of Correlation Coefficients 
E3<peri mental Groijp/ Unit I 





Age 


Total 
IQ 


Race 


Reading 
Achieve- 
ment 


veroai 
Partici- 
pation 


Pre- 
test 


Time 


Post- 
test 


Sex 


-.138 


1.166 


-.062 


.080 


-.040 - 


.241 


.018 


-.238 


Age 




-.049 


-.171 


.271 


.092 


.250 


-.210 


• 287 


Total IQ 






-.066 


.294 


.307 


.411 


-.133 


.469 


Race 








-.118 


-.176 - 


.047 


.4.5 


-.063 


Reading 
Achieve- 
ment 










.387 


.168 


-.141 


.279 


Veri>al 
Partici- 
pation 












.080 


-.163 


.230 


Pretest 














-.023 


.665 



Time 



-.032 



Table 71. Multiple Stepwise Regression Analysis 
Experimental Group, Unit I 



Step 

Num- Variable 
ber Entered 



Multiple 



Increase 
2 

m r 



No. of 
F- Value Independent 
to Remove Variables 



1 


Pretest 


.6649 


.4421 


.4421 


129.9423 


1 


2 


Total IQ 


.6989 


.4884 


.0464 


14.7708 


2 


3 


Age 


.7178 


.5153 


.0269 


8.9790 


3 


4 


Verbal Par- 


.7244 










ticipation 


.5247 


.0094 


3.1828 


4 


5 


Time 


.7272 


.5288 


.0041 


1.3900 


5 


6 


Sex 

Reading 


.7288 


.5311 


.0023 


0.7883 


6 


7 


Achieve- 
ment 


.7311 


.5345 


.0034 


1.1467 


7 


8 


Race 


,7311 


.5345 


.0000 


0.0114 


8 



Tne effect of the pretest accounts for approximately 44.2 percent 

of the variance in the regression equation. This datum is determined 
2 

by the multiple r in Table 71. With the 16-item instrument used 
during the Spring, 1970 testing of Unit 1, the pretest accounted for 
only 23.6 percent of the varicince in the regression equation. The 
chcmge from 23.6 to 44,2 percent of the variance being accounted for 
by the pretest is a significant iir^rovement. 

The combination of pretest cind WISC Total IQ as an independent or 
predictor variable accounts for 48. B percent of the variance^ and the 
combination of pretest, WISC Total IQ, cind age accounts for 51.5 per- 
cent. The inclusion of all eight independent variables accounts for 
53.5 percent of the variance in the regression equation. This is a 
significant inprovement when compared to the 30.6 percent of the variance 
accounted for by the effect of the six independent variables in the 
regression equation of the Spring, 1970 testing. 

Information and e3q)erience acquired by the BSCS staff in the ini- 
tial testing and evaluation o^ Unit I have proven extremely valuable in 
revising old items and writing new items for the current testing period, 
as demonstrated by the higher reliability and biserial calculations. 

As was indicated in the Spring, 1970 evaluation of ME NOW, 
student-student and student- teacher interactions are very important 
variables that need to be investigated. Unfortunately, sufficient funds 
are not available for videotape equipment or for personnel trained in 
interaction protocol to gather th^: necessary data. 

Objective Achievement Tests 

Analyses of Variance and Co variance . Experimental Group , Unit I . 
Two statistical tests were performed to investigate the question, "Is 
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there a significant difference between ea^erimental clcisses in the level 
of achievement on the Unit I posttest?" The results of an analysis of 
covariance are summarized in Table 72 and indicate no significant dif- 
ference between classes on posttest means adjusted for differences in 
pretest scores. Table 73 summarizes the means and standard deviations 
for pretest and posttests for each class in the experimental group. 



Table 72. Analysis of Covariance between Classes on 
Adjusted Unit I Posttest Means, Pretest as Covariate 



Source 




d.f. 


Mean 


Sauare 


F- Ratio 


Between Groups 


15 


19.2449 


1.4419 


Within Groups 


164 


13. 


8860 




^.05(15,164) ^ 


67, no significant difference 




Table 


73. N, 


Means, Standard Deviations 


and Adjusted Means 




of 16 


Classes, Experimental Group 


, Unit I 






















Posttest 


Adjusted 




Class 




Posttest 


Standard 


Posttest 


Pretest 


Number 


N 


Mean 


Devi at j ons 


Mean 


Mean 


21 


5 


19.40 


8.20 


18.30 


17.20 


22 


13 


18.00 


4.24 


18.73 


14.85 


23 


12 


22.00 


3.95 


22.03 


15.75 


24 


10 


18.70 


4.88 


19.86 


14.30 


25 


11 


23.64 


2.84 


22.55 


17.18 


26 


10 


26.30 


2.21 


21.85 


21.50 


27 


10 


21.20 


5.05 


20.95 


16.10 


28 


8 


23.13 


3.68 


22.47 


16.63 


31 


6 


10.67 


5.35 


21.67 


14.50 


32 


11 


15.73 


7.39 


17.82 


13.09 


•^3 


10 


22.50 


2.64 


21.79 


16.70 


34 


10 


21.20 


2.35 


19.94 


17.40 


35 


10 


18.00 


3.23 


20.17 


13.00 


36 


11 


21.45 


5.00 


21.14 


16.18 


37 


15 


20.40 


5.10 


21.22 


14.73 


38 


14 


20.07 


4.27 


20.68 


15.00 



since the effect of a regression to the posttest mean could have 
influenced the results of the analysis of covariance, an analysis of 
variance was confuted between experimental classes with residual gain 
scores as the dependent variable • The residual gain score minimizes 
the effect of the regression to the posttest mean that is inherent in 
a pretest-posttest design. Residual gain is defined as the difference 
between a predicted score (Y* = a + bX) and the actual score (Y) on the 
posttest, or Y-Y', where; 

Y' = predicted posttest score 

a = Y intercept of the regression line (constant) 
b = slope of the regression line (the within-class 

pooled regression coefficient, in this case) 
X = actual pretest score 

17 

Y = actual posttest score 

The within-class pooled regression coefficient was used in this 

confutation instead of the raw regression coefficient to preserve the 

teacher effect. These are not the same residual gain scores reported 

in Table 67. Table 74 shows the results of the analysis of variance, 

Table 74. Analysis of Variance between Classes 
on Residual Gain Scores, Experimental Group, Unit I 



Source 



d.f. 



Mean Square 



F- Ratio 



Between Groups 
Within Groups 



150 



20.4654 



13.2576 



1.5437 



^.05(15,150) 



= 1.67 no significant difference 



Kenneth D. Hopkins. "Regression and the Matching Fallacy in Quasi- 
Experimental Research," Jml . of Special Education , 3(4) :329-36 (1969). 
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indicating no significant difference between classes on residual gain 
scores. This is the same result that was obtained with the reduced, 
16-item test during the Spring, 1970 testing. Table 75 summarizes the 
means and standard deviations for residual gain scores for ea^ class 
in the es^eriroental group. 



Table 75, Residual Gain, Class Data 
Experimental Group, Unit I 



Class 






Standard 


Standard 








Number 


N 


Mean 


Deviation 


Error 


Maximum 


Minimiom 


Range 


21 


5 


-2.40 


5.39 


2.41 


3.24 


-10.97 


14.21 


22 


13 


-1.97 


4.53 


1.26 


3.91 


- 9.31 


13.22 


23 


12 


1.33 


3.13 


0.90 


6.58 


- 2.87 


9.45 


24 


10 


-0.84 


4.89 


1.55 


6.25 


- 8.75 


15.00 


25 


11 


1.85 


2.78 


0.84 


7.13 


- 2.20 


9.33 


26 


10 


1.15 


2.38 


0.75 


4.80 


- 2.98 


7.78 


27 


10 


0.26 


3.61 


1.14 


5.69 


- 5.65 


11.34 


28 


8 


1.77 


3.65 


1.29 


7.25 


- 3.20 


10.45 


31 


6 


0.97 


3.21 


1.31 


4.69 


- 3.08 


7.77 


32 


11 


-2.87 


5.63 


1.70 


4.25 


-15.97 


20.22 


33 


10 


1.09 


2.62 


0.83 


5.36 


- 2.42 


7.78 


34 


10 


-0.76 


2.26 


0.72 


2.13 


- 4.76 


6.89 


35 


10 


-0.53 


2.80 


0.88 


3.47 


- 4.41 


7.88 


36 


11 


0.45 


2.77 


0.84 


4.58 


- 4.42 


9.00 


37 


15 


0.52 


3.65 


0.94 


8.37 


- 7.53 


15.90 


38 


14 


-0.02 


3.42 


0.91 


5.59 


- 6.75 


12.34 



Factorial Analyses , Experimental Group . The results of the 
multiple linear regression on the posttest indicated that age and IQ 
were significant predictors of success on the posttest (p<.001) . To 
further investigate this result and to minimize the effect of the re- 
gression to the posttest mean, the following question was investigated: 
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"Is there a significant difference in residual gain scores between 
students blocked on three ranges of age and three ranges of WISC 
Verbal IQ scores?" 

To answer this question, residual gain scores for the 116 students 
with WISC Verbal IQ data were blocked on three different ranges of ag?: 
<137 months, 138 to 155 months, and >^156 months; and on three ranges 
of WISC Verbal IQ scores: <66, 67 to 79, and >80. An analysis of 
variance was performed on the residual gain scores in this 3x3 factorial 
design. Table 76 contains the results of the analysis of variance, 
indicating no significant difference between the three blocks of ages, 
a significant difference between the three blocks of IQ scores, and 
no significant interaction effects. A significance level with a P 
greater than .05 is considered not to be significant. Table 77 sum- 
marizes the N, means and standard deviations for the residual gain 
scores by cells, rows and columns. 



Table 76. ANQVA, Residu£.l Gain Blocked on Verbal 10 
and Age, Experimental Group, Unit I 



Source 


d. f . 


Hypothesis 
Mean Square 




F 


Significance 
Level 


Between Age Groups 


2 


15.5359 


1. 


4908 


P<.2299 


Between IQ Groups 


2 


73.8285 


7. 


0847 


P<.0013 


Interaction 


4 


20.4430 


1. 


9617 


P<.1056 


Within Groups 


107 


10.4209 









To determine the effect of age and WISC Performance 13 scores 
on residual gain scores, the following question was investigated: 
"Is there a significant difference in residual gain scores between 
students blocked on three ranges of age and three ranges of WISC Per- 
formance IQ scores?" 
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To answer this question, residual gain scores for the 116 students 
with Wise Performance IQ data were blocked on the same three ranges 
of age {<137 months, 138 to 155 months, and >^156 months) and WISC 
Performance IQ scores (£66, 67 to 79, and >^80) , An analysis of 
variance was performed on the residual gain scores in factorial 



Table 77, N, Mean Residual Gain Scores & Standard Deviations by 
Cells, Age and WISC Verbal IQ, Experimental Group, Unit I 



Age 
Levels 


WISC Verbal IQ Levels 


I Rows 


<ee 


67-79 


>^80 


£137 
months 


N = 8 
M - -3-0447 
SD = 3,8837 


N = 17 
M = 0,7127 
SD = 4.3208 


N = 18 
M = -0,5216 
SD = 3,1016 


N = 43 

M = -0,5031 


138-155 
months 


N = 8 
M = -3,3354 
SD 4,8265 


N = 25 
M = 1,3066 
SD = 2,7876 


N = 15 
M = 1,5697 
SD = 2.2374 


N = 48 

M = 0,6152 


>^156 
months 


N = 8 
M = -0,2540 
SD = 2,1790 


N = 12 
M = -0,0714 
SD = 2,5640 


N = 5 
M = -0,8473 
SD = 2,3453 


N = 25 

M = -0.2850 


Z Columns 


N = 24 

M = -2,2110 


N = 54 

M = 0,8134 


N = 38 

M = 0,2611 





design. As summarized in Table 78, the results of the analyses of 
variance indicate no significant djfferances between the three blocks 
of ages, or the three blocks of IQ scores, and no significant inter- 

Table 78. ANOVA, Residual Gain Blocked on PerfojTnance IQ and Age 

Experimental Group, Unit I 



Hypothesis Significance 



Source 


d.f. 


Mean Square 


F 


Level 


Between Age Groups 


2 


15,5359 


1,3531 


P<,2629 


Between IQ Groups 


2 


30,7427 


2.6776 


P<,0734 


Interaction 


4 


13.6133 


1,1857 


P<,3214 


Within Groups 


107 


11.4815 







ac^-^on effects. Table 79 sunimarizes the means and standard devi- 
ations for *- re" ..dual gain scores by cells, rows and columns. 

To determine the effect of age and WISC Full Scale IQ scores on 
residual gain scores, the following question was investigated: "Is 
there a significant difference in residual gain scores between students 
blocked on three ranges of age and three ranges of WISC Full Scale IQ 
scores?" 

To answer this question, residual gain scores for the 166 students 
with WISC Fu31 Scale IQ data were blocked on the same three ranges of 
age (_<137 months, 138 to 155 months, >_156 months) and WISC Full Scale 
IQ scores (^66, 67 to 79, and >_80) . An analysis of variance was per- 
formed on the residual gain scores in the 3x3 factorial design. In 

Table 79. N, Mean Residual Gain Scores & Standard Deviations by 
Cells, Age and WISC Performance IQ, Experimental Group, Unit I 



Age WISC Numerical IQ Levels 



Levels* 


<ee 


67-79 


>_80 


Z Rows 


£137 
months 


N = 8 
M = -0.2904 
SD = 4.7058 


N = 18 
M = -1.1444 
SD = 4.1960 


N ^ 17 
M = 0.0759 
SD = 3.3246 


N = 43 

M = -0.5031 


138-155 
months 


N = 13 
M = -1.6504 
SD = 4.3872 


N = 18 
M = 1.2452 
SD = 3.2349 


N = 17 
M = 1.6806 
SD = 2.0629 


N = 48 

M = 0.6152 


>^156 
months 


N = 5 
M = 1.3962 
SD = 1.1926 


N = 9 
M = 0.3046 
SD = 2.4003 


N = 11 

M = -0.2623 


N = 25 

M = 0.2850 


S Columns 


N = 26 

M = -1.1830 


N = 45 

M= 0.1012 


N = 45 

M = 0.5994 





Table 80 the results of the analysis ot variance indicate no significant 
differences between the three blocks of ages, a significant (P<.0041) 
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difference between the three blocks of IQ scores, and no significant 



interaction effects 


Table 


81 siunmarizes 


the N, means 


and standard 


deviations for the 


residual 


gain scores by 


cells, rows 


and columns. 


Table 80. ANOVA 


9 Residual Gain Blocked 


on Wise Full 


Scale IQ 


and Age , Experimental Group 


, Unit I 








Hypothesis 




Signi ficance 


Source 


d.f. 


Mean Square 


F 


Level 


Between Age Groups 


2 


33.0996 


2.5189 


P<.0839 


Between IQ Groups 


2 


75.1098 


5.7158 


P<.0041 


Interaction 


4 


4.0281 


0.3065 


P<.8733 


Within Groups 


157 


13.1407 







Table 81. N, Mean Residual Gain Scores and Standard Deviations by 







Age 
Levels 


Wise Full Scale IQ Levels 


I Rows 


£66 


67"79 


>^80 


<_137 
months 


N = 10 
M = "2.3509 
SD = 5.3415 


N = 35 
M = "0.5371 
SD = 4.6948 


N = 12 
M = -0.4153 
SD = 2.9554 


N = 57 

M = "0.8296 


138-155 
months 


N = 18 
M = "1.6844 
SD = 3.9351 


N = 43 
M = 1.3539 
SD = 3.0296 


N = 12 
M = 1.2697 
SD = 1.7865 


N = 73 

M = 0.5909 


>^156 
months 


N = 10 
M = "0.7741 
sb = 2.4176 


N = 21 
M = 0.4862 
SD = 2.9044 


N = 5 
M = 0.9969 
SD = 3.7306 


N = 36 

M = 0.2071 


I Columns 


N = 38 

M = "1.6200 


N = 99 

M = 0.5013 


N = 29 

M = 0.5254 
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Discussion 

The analyses of variance were made in a 3x3 factorial design with 
xo'^idual gain scores blocked in low, middle and high ranges of Wise 
Verbal, Performance and Full Scale IQ scores and on three age ranges. 
The results indicate that there is no significant difference between 
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the three age groups when the residual gain score is the dependent 
variable, m the light of this result, the fact that age was a signifi- 
cant predictor of posttest scores (P<.025) is probably attributable in 
part to the effect of a regression to the posttest mean. 

There was no significant difference between the three troves of 
students in low, ii i^iljii |1i ranges of WISC Performance IQ scores. 

We concluded fr^ this result that the effect of WISC Perfomance IQ 
on poi^test si/ccess has been minimized. Although many psychomotor and 
eye-ha^d coo/dination skills are employed throughout Unit I, students 
with aow Wlffi^'Performance IQ scores seemed to achieve as well as students 
with high WISC Performance IQ scores. Also, no significant interaction 
effects were detected between age and Verbal, Performance or Full Scale 
IQ. 

The result of tha analysis of variance, with residual gain scores 
blocked on age and Verbal IQ scores, indicates a significant difference 
between students in the low, miidle and high IQ groups. An examina- 
tion of the mean scores indicates that the middle and high IQ groups 
are achieving higher residual gain scores than the low IQ group. (Since 
ME NOW materials stress verbal interaction among students and between 
students and the teacher, this result is not surprising.) In view of 
this result, it would seem that the ME NOW materials as presently 
constituted are best siiited for students with WISC Verbal IQ scores 
above 66. 

Limited subjective data based on classroom visits by BSCS staff 
members indicate that many teachers are not involving their slower 
students in classroom discussions. This observation may be valid or 
could be a result of the teadier.^' involving mainly verbal students to 

ERLC 
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"look good" for visiting personnel. Special efforts will have to be 
made by BSCS personnel to suggest ways in which teachers can involve 
students with low Verbal IQ scores. This should be a major goal of the 
team revising the Unit I materials. 

The results of the analysis of variance with residual gain scores 
blocked on age and WISC Full Scale IQ scores indicates a significant 
difference between students in the low, middle and high IQ groups. 
An examination of mean residual gain scores reveals that the middle and 
high T^Q groups are achieving higher success than students in the low 
group. This result indicates that the ME NOW materials are successful 
./ith a large part of the EMH population, ages 11 to 13/ but teachers 
will need to provide additional help and stimuli to students in the 
low 10 ranges. Again, BSCS personnel should include suggestions for 
the teacher in the revised Teacher's Guide on how to overcome this 
problem. 

Experimental-Control Group Analyses . To investigate the question, 
"Is there a significant difference between the experimental and control 
groups in the residual gain scores?" these scores were calculated using 
the raw regression coefficient, obtained by pooling all experimental 
and control students, and an analysis of variance was performed on the 
residual gain scores between the two groups. Table 82 summarizes the 
mean residual gain scores and standard deviations for both groups. 

Table 83 summarizes the results of the analysis of variance, 
indicating a significant (P<.001) difference between the experimental 
and control groups. 



103 



Table 82. Residual Gain Means and Standard Deviations 
Experimental and Control Groups ^ Unit I 

Group N Mean Standard 
Devi ati ons 



Experiinental 166 2,1254 3.7501 

Control 168 -2 . 1002 2 . 8?80 



Table 83. ANOVA, Experimental and Control Residual 
Gain Scores, Unit I 

Source d. f. Mean Square F-Ratio 

Between groups 1 1490.8623 135.3835** 

Within groups 332 11.0121 

**F 001(1 332) ~ 10-83, significant at the .001 level 



Discussion 

The results of the analysis of variance indicated that there 
was a significant difference (P<.001) between the experimental and 
control groups on residual gain scores. We therefore concluded that 
the e3q>erimental Unit I ma^-erials did have an effect on EMH students 
as assessed by *-iie objective tests. All 30 items assessed key objec- 
tives in Unit I, 13 were judged to measure Daseline information, and 
17 were considered to be good indicators of student growth from pretest 
to posttest. 



Factor Analysis , To determine the structure of the Unit I 
achievement tests, a Harris-Kaiser oblique, unnormalizei, orthogonal 
rotation vas performed on the results of posttests A and B. For post- 
test A, 18 factors were identified which accounted for 54 percent of 
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the variance. For posttest B, 18 factors were identified which 

accounted for 55 percent of the variance • 

Table 84 presents the results for posttest A showing only those 
factors with eigenvalues above 1, The objective measured and cogni- 
tive level of each item is included, as is a hypothetical name for 
each factor- The cognitive levels identified are knowledge, low 

(conprehension, application), and high (analysis, synthesis, evalu- 
18 

ation.) Table 85 presents the results for posttest B, showing 
only those factors with eigenvalues above 1* 

Table 84. Factor Structure - Unit I, Posttest A 



Factor 


Items 


Cognitive 
Level 


Objective 


Name 


1 


21 


High 


100 


food-blood sugar 




28 


Low 


107 


relationships 


2 


10 


Low 


100 


heartbeat-pulse 




25 


High 


100 


relationships 


3 


6 


Knowledge 


105 


sugar test-digestion 




17 


Knowledge 


104 




4 


2 


Knowledge 


106 


heartbeat-pulse 




7 


Lew 


106 


relationships 


5 


8 


Knowledge 


101 


food-stomach action 




9 


High 


105 




6 


4 


Low 


100 


graphing-f unctions 




5 


Knowledge 


103 


of mouth parts 




10 


Low 


100 






24 


Low 


103 






2 


Knowledge 


106 





Benjamin S. Bloom (Editor) . Taxonomy of Educational Objectives Hand- 
book Cognitive Domain , New York: David McKay Company, Inc. 1956? 



105 



Table 85. Factor structure - Unit I, Posttest B 



Factor 


Items 


Cognitive 
Level 


Objective 


Name 


X 




High 


100 


food-blood 






ivnowJ.euCf6 


106 


relationships 






Knowledge 


101 


food- functions of 




17 


Low 


103 


mouth parts 




28 


High 


106 




3 


3 


Low 


106 


heartbeat-pulse 




28 


High 


106 


relationships 


4 


4 


Low 


103 


digestive processes 




30 


Low 


105 




5 


25 


Low 


108 


digestion-diffusion 




29 


Low 


107 






9 


Knowledge 


103 





Items 10 and 25 from posttest A and the parallel items, 3 and 
28 from posttest B, appeared in both factor analyses as a single 
factor. Both pairs of items deal with heartbeat -pulse relationships. 
In general, items loading on the six factors of posttest A with eigen- 
values above 1 and on the five factors of posttest B with eigenvalues 
above 1 were well distributed across the test, items loading on in- 
dividual factors were generally measuring identical or related instruc- 
tional objectives. 

Summary 

We can safely conclude that students using Unit I of ME NCW 
learn from the use of these materials. Students with WISC Full Scale 
IQ scores of 66 and higher tend to perform better on achievement tests 
than students with lower scores. Achievement test results have iden- 
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tified some instructional problems amd problems with items themselves 
that have resulted in modifications in both the instructional material 
and the test items. Teacher feedback indicates a high degree of student 
interest and motivation and has also helped identify some problems that 
have brought about revisions of the materials. 
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CHAPTER III 
EVALUATION OF UNIT II 
RESPIRATION AND EXCRETION 



The Instructional Program 

In the experimental classes, pretests for Unit II were administered 
and instruction was initiated between January 5 and March 2, 1971. The 
posttests were administered from February 1 to Marcn 31, 1971. The 
total me£ui time in class devoted to this unit of ME NOW during the 
instructional period for the 16 classes was 557 minutes (9.3 hours). 

Unit II is focused on the role of respiration and the fate of un- 
digested food in "Me Now." In keeping with the philosophy of beginning 
with external and concrete evidence and proceeding to internal, more 
abstract and inferred data, this unit begins with observations of chest 
expansion during breathing. By holding paper bags over their mouths 
while breathing, students can infer that air is moving in and out of 
their chests and then verify this through the use of an artificial 
model. 

The necessity of air for energy release is established by burning 
cam dels in open amd closed containers and by using slides which portray 
mice in open and sealed compartments. Oxygen and carbon dioxide, the 
major components of the air involved in respiration are identified J^y 
student investigations. Quantitative measures of the relative amounts 
of oxygen and carbon dioxide in inhaled and exhaled air are made which 
help the students understand that more oxygen is taken into the body 
than is given off, and that more carbon dioxide is given off than is 



108 



taken into the body. The danger of suffocation in abandoned refrigera- 
tors and plastic bags is portrayed through the use of newspaper articles. 

Attention is then shifted to the relationship between muscle 
activity, breathing rates and a need for energy. Energy from wind, 
fuel, food, etc. is studied, and the need for food and oxygen in per- 
forming body activities is established. Attention is focused again on 
the circulatory system as a means for distributing food and oxygen to 
the muscles where they are used in energy production. Waste products 
of food "burning" and "excess water" are studied, and the fate of undigested 
food in the intestines is reviewed. The role of the urinary system in 
removing metabolic wastes and excess water is established and investigated 
through the use of an artificial model. This series of activities is 
completed with a study of perspiration followed by a review of the major 
points in Units I and II. 

Effectiveness of Instruction ; 
Data , Analysis and Interpretation 

Objective 200 . Students will infer that breathing is a necessary 
life process . To achieve this objective six student activities with 
related instructional strategies were designed to develop student com- 
petencies. For activities 1 and 2, 75 percent of the teachers reported 
they used the strategies as prescribed; 25 percent reported some modi- 
fications; 97 percent of the teachers reported that the strategies were 
successful. One teacher reported difficulties because she did not know 
where the diaphragm is located. An excellent modification was developed 
by one teacher: "We followed the context ~ but went a step further. 
In the string-chest experiments we used a longer string and marked it 
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with a felt pen at the spot [indicating] normal chest [diameter] . 
Then as I held the string, the model breathed deeply and we watched 
the string 'grow.' We noted the inches ~ th^n we did the chalJcboard 
list ~ we noted that the chalk mark on the board corresponded in length 
with the expansion [string] measurements." 

Figure 42 shows that teachers foiand student reactions to be very 
high across the three rating scales. Botli activities were very important 
for EMH students (see Figure 43) . 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 

Percent of 
teachers 50 - 
(N=16) 




5432154321 '5 4321 

Figure 42. Reaction of the majority of students 
to activities 1 and 2 



5 = high 
3 = neutral 
1 = low 



100 



Percent 50 




I 



5 4 3 2 1 
Important m ok Useless 



Percent of 
teachers 
(N=13) 



Figure 4 3. Importance to students of activities 1 and 2 
Figure 44 shows the proportion of students who were able to per- 
form the behaviors specified by the subobjectives for activities 1 and 
2. Figure 45 shows that teachers rated che subobjectives as being 
very important for EMH students. 
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50 


- 46 






31 ■ 




Percent 




16 


0 




B 4^ 1 _2 



I 



All 3 I I A None 
4 2 4 4 



Figure 44. Proportion of 
students able to perform 
on subobjectives for 
activities 1 and 2 



100 



71 

so J 

Percent of ■ ■ Percent of 

teachers I ■ I ^^^^^^^^ 

' (N=16) 0 II 1 1. L J ■ (N=15) 

5 4 3 2 1 
Important OK Useless 



Figure 45. Importance of the 
subobjectives 



For activities 3 and 4, 56 percent of the teachers reported using 
the strategies as prescribed; 31 percent reported some modification; 
six percent reported much modification; and six percent replaced the 
strategies. Sixty-nine percent of the teachers reported that the strate- 
gies were successful, while 19 percent reported that the strategies 
were unsuccessful. 

Several serious problems were encountered in activity 4 that led 
to the low ratings. First, students were asked to record the time 
interval from beginning the oxygen test experiment to the time when 
the methylene blue solution turned color. Most students encountered 
difficulties measuring and recording time intervals. Some teachers 
changed the strategies and had the students count and record the number 
of breaths required to change the color of the methylene blue, and 
this was successful. The final materials were revised to include this 
change. Second, most of the methylene blue solutions, which had been 
prepared several weeks ahead of time, had broken down and would not 
change color. Those teachers who mixed a fresh supply of methylene 
blue reported that experiment successful. The Teacher's Guide was 
revised to have the teachers prepare the methylene blue solution just 
before the class begins. 
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Interest 
Disinterest 



Pleasure 
Displeasure 



loo 



Willingness 
I'nwillingness 



Percent of 
teachers 
(N*16) 




high 

neutral 

low 



majority of students 
to activities 3 and 4 



100 



Percent 50 




I 



5 4 3 2 1 

Important OK ^ Useless 

Figure 47. Inportance to students of activit 
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100 



50 



All 1 1 1 A None 
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Figure 48. Proportion of 
students able to perform 
on subobjectives for 
activities 3 and 4 
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5 4 3 2 1 

Important OK Useless 

Figure 49. Iirportance of the 
siabobjectives 



Percent of 
taachers 
(N=15) 



Figure 46 shows student reactions to be very high across the 
three rating scales, in spite of the difficulties encountered. Both 
activities were important for EMH students (see Figure 47) . 

Figure 48 shows the proportion of students who were able to per- 
form the behaviors specified for activities 3 and 4. Because of the 
difficulties, a rather wide distribution was obtained. Figure 49 shows 
the subobjectives for activities 3 and 4 were very important for EMH 
Students. 
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For activities 5 and 6/ 58 percent of the teachers reported using 
the strategies as prescribed; 33 percent reported some modification; and 
eight percent reported much modification. The carbon dioxide test solu- 
tion (calcium hydroxide) worked perfectly, but students still had 
difficulties in meetsuring and recording time intervals. Most teachers 
used the breath-counting technique which was very successful. Some 
difficulties were encountered with the two worksheets in activity 5 
because questions dealing Loth with carbon dioxide and oxygen were 
presented on the same worksheets. These worksheets have been separated 
to avoid this confusion. 

For activity 6/ stories of suffocation and drowning were very 
successful. One teacher wrote, "Activity 6 was a great success — 
the discussions led into personal experience — one boy had been a near 
victim of asphyxiation in the family camper. His story led to a lesson 
on safecy. One boy asked, 'What is the difference between carbon 
monoxide and carbon dioxide?' We got out our dictionaries — looked 
them up and learned the meanings of the prefixes 'mono* and 'di' — 
Good experience." 

Figure 50 shows student reactions to be very high across the three 
rating scales. Both activities were judged as very important for EMH 
students (see Figure 51) . 

Figure 52 shows the proportion of students who were able to per- 
form the behaviors specified by the sijbobjec lives for activities 5 and 6. 
In spite of the difficulties encountered measuring periods of time, 
76 percent of the teachers reported that three- fourths or more of their 
students could perform the specified behaviors. Figure 53 shows the 
activities were very important for EMH students. 
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Interest 



Pleasure Willingness 



Percent of 
teachers 
(N=16) 



100 



50 



Disinterest 


Displeasure 


Unwillingness 


69 


69 


63 


L 


1i. 





5 = high 
3 = neutral 
1 = low 



543215432154321 

Figure 50. Reaction of the majority of students 
to activities 5 and 6 
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Important OK * Useless 

Figure 51. Importance to students 6f activities 5 and 6 
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Figure 52. Proportion of 
students able to perform 
on subobjectives for 
activities 5 and 6 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 

Important * OK Useless 

Figure 53. Importance of the 
sijbobjectives 



Nine item pairs were designed to sanple achievement on objective 



200. 



WHAT PART IS M LUNG? . 

Hark an X in tme circle on the line that touches the part. 



2a what part is the LUNG? 26b 
Hark an X in the circle on the line tha. touches the part. 
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Item pair 26-B functions at the cognitive level of knowledge. 

Mean total gain from pretest to posttest for the experimental group was 
2 3 percent (from 68 to 91 percent). This gain can be accounted for 
by losses from all other response choices. There was a mean net loss 
of two percent (from 67 to 65 percent) for the control group. With 
these results we can clearly attribute experimental group gains to the 
effect of instruction. Biserial correlations are exceptionally high 

for this item pair. 

Table 86. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 

# 


Pretest 


Posttest 


^b 


N 


Percent- of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


2-A 
26-B 


79 
95 


73 11 8 6 1 0 
19 8 64 7 1 0 


95 
79 


86 1 13 0 0 0 
0 0 97 3 0 0 


.64 
.67 


.65 
.60 


Control 


2-A 
26-B 


80 
89 


70 5 19 4 3 0 
24 4 65 7 0 0 


89 
80 


65 10 17 7 0 0 
21 6 65^ 6 1 0 


.45 
.32 


.38 
.65 



Table 87. Pretest to Posttest Changes 
(The response choice for 2-A is cited first.) 



Item Pair 2- 


"A, 26-B 


Percent Change, 


Pretext to 


Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Distractor Pairs 




A 


C n+C 


B 


B B+B 


C 


A 


C+A 


D D 


D+D 


Experi- 
mental 


+13 


+33 +23 


-10 


-8 -8 


+ 5 


"19 


-7 


-6 -4 


-6 


Control 


-5 


0 -2 


+ 5 


+ 2 +4 


-2 


-3 


-3 


+ 3 -1 


+1 



Item pair 8-A, 3-B functions at the cognitive level of analysis. 
Mean total gain from pretest to posttest for the experimental gi oup 
was 16 percent (from 37 to 5 3 percent) . The gain can be accounted for 
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WHICH PERSON IS TESTING THE AMOUN^ OF OXYGEN IN EXHALED AIR^ 8a 
Mark an X on that person. 



-z-^ it^'-s.s' "^4" 



WHiCH PERSON IS TESTING THE AMOUNT OF CARBON OIOXIOE IN 
EXHALED AIR-? 

Mark an X on that person. 



ft 







II 





by losses from all other response choices. A posttest level of achieve- 
ment of 53 percent is entirely satisfactory due to the complex nature 
of the task involved in answering this question. There was a mean 
net loss of one percent (from 46 to 45 percent) from pretest to post- 
test for the control group. The gains registered by the experimental 
group can be attributed to the effect of instruction. Biserial cor- 
relations indicate that both items are good discriminators. 

Table 88. Item Responses cind Biserial Correlations 
for E3q)erimental cind Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


8-A 
3-B 


79 
95 


15 23 46 16 0 0 
14 19 29_ 33 1 4 


95 
79 


18 19 53_ 11 0 0 
16 18 52 14 0 0 


.48 
.21 


.31 
.42 


Control 


8-A 
3-B 


80 
89 


11 16 48 21 4 0 
16 24 44 16 1 0 


89 
80 


16 20 45^ 17 0 2 
24 10 45 20 0 1 


.25 
.29 


.44 
.49 



Table 89. Pretest to Posttest Changes 
(The response choice for 8-A is cited first.) 



Item Pair 8-A, 3-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Distractor Pairs 




C C C+C 


A 


A A+A 


B 


B 


B+B 


D D 


D+D 


Experi- 
mental 


+7 +23 +16 


+ 3 


+2 +3 


-4 


-1 


-2 


-5 -19 


-13 


Control 


-3 +1 -1 


+5 


+ 8 +6 


+4 


-14 


-5 


-4 +4 


0 
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WHAT PART ON THE MODEL WORKS LIKE THE DiAPHRAGfl 9* WHAT PART ON THE MODEL WORKS LIKE LUNGS IN YOUR BODY^ 7i 

(BREATHING-MUSCLE)' 

Mark an X \h the ,ifiCLE oh tmE imt that touches the part. 




Item pair 9-A/ 7-B functions at the cognitive level of conpre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 21 percent (from 46 to 67 percent). This gain can be attrib- 
uted to losses in all other response choices. There was a mean net 
gain of seven percent (from 41 to 48 percent) from pretest to posttest 
for the control group. The greater mean net gain from pretest to 



Table 90. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


9-A 
7-B 


79 
95 


3 6 75 16 0 0 

4 71 4 21 0 0 


95 
79 


3 3 37 57 0 0 
1 2§. 14 6 0 0 


.19 
.29 


.70 
.36 


Control 


9-A 
7-B 


80 
89 


6 8 73 13 1 0 
3 67_ 7 20 2 0 


89 
80 


2 8 65 21 1 2 
1 78 4 18 0 0 


.30 
• 41 


.67 
.66 



Table 91. Pretest to Posttest Changes 
(The response choice for 9-A is cited first.) 



Item Pai 


r 9-Ar 7-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


D B D+B 


A A A+A 


B D B+D 


C C C+C 


Experi- 
mental 

Contro] 


+41 +7 +21 
+8 +11 +7 


0 -3 -2 
-4 -2 -2 


-3 -15 -10 
0 -2 -1 


-38 +10 -10 
-8 -3 -5 
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posttest and the higher posttest achievement level of the experimental 
group enable us to attribute the success of the experimental group to 
the effect of instruction. The biserial correlations indicate that 
both items are good discriminators. 



if you w[r£ going on a trip ih a su8narine. which of 
These would vou need most'> 



11* IF YOU WERE GOING m A TRIP IN A SUBMARINE WHICH Of 

these would you need «0ST'> 



fUtH AN X IN TnE PICTU»» yOU CmOOSC. 




fU«K AN X ON TmE PICTUR£ yOU CHOOSE. 



Item pair 11-A, 1-B is a baseline item and functions at the cog- 
nitive level of analysis. Mean net gain from pretest to posttest for 
the experimental group was 12 percent (from 81 to 93 percent). The 
high pretest level indicates that this item is measuring data already 
known by many of the students in the experimental group. The pretest- 
to-posttest gain can be attributed to losses in all other response 
choices. For the control group, there was a mean net loss of one 
percent (from 89 to 88 percent). The high achievement level of the 
control groi^) on the pretest confirms the conclusion that most EMH 
students in our sample are familiar with the m?terial covered by this 
item pair. The pretest-to-posttest gains in the experimental group 
can be attributed to the effect of instruction. The biserial cor- 
relations indicate that both items are good discriminators. 
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Table 92* Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


r 

b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


11-A 
1"B 


79 
95 


85 6 9 0 0 0 
14 1 77 8 0 0 


95 
79 


92 7 0 1 0 0 
3 0 9£ 4 0 0 


• 42 

• 35 


,46 
• 61 


Control 


11-A 
1-B 


80 
89 


9£ 4 5 1 0 0 
8 1 89^ 1 1 0 


89 
80 


85 3 7 2 1 1 
4 0 91 5 0 0 


• 73 

• 41 


,55 
• 58 



Table 93 • Pretest to Posttest Changes 
(The response choice for 11-A is cited firsts) 



Item Pair 11-A, 1-B 


Percent 


Change , 


Pretest to 


Posttest 




Student 


Correct 
Choice 




Parallel 


Distractor 


Pairs 






Group 


A C A+C 


B A 


B+A 


C 


B C+B 


D 


D 


D+D 


Experi- 
mental 


+7 +17 +12 


+1 -11 


-5 


-9 


-1 -5 


+1 


-4 


-2 


Control 


-5 +2 -1 


-1 -4 


-3 


+2 


-1 +1 


+1 


+4 


+2 



Item pair 12-A, 27-B fxinctions at the cognitive level of knowledge 
Mean net gain from pretest to posttest for the experimental group was 
nine percent (from 59 to 68 percent) • The pretest-to-posttest gain 
can be attributed to losses in all response choices except hl\>e (A in 
Form A, D in Form B) , where a mean net gain of nine percent (from nine 
to 18 percent) was recorded^ This result confirms reports by the 

CARBON DIOXIDC TEST SOLUTION LOOKS LIKE HATER. 12* 



WHAT COLOR Does CARBON DIOXIDE TEST SOLUTION CHANGE 
TO WHEN CARBON DIOXIDE IS BUBBLED THROUGH IT^ 



RaRK an X ON TH£ PICTURE. 



CARBON OiOXiDE TEST SOLUTION LOOKS LIKE WATER. 



WHAT COLOR DOES CARBON DIuXiDE TEST SOLUTION CHANGE 
TO WHEN CAPBON DIOXIDE IS BUBBLED THROUGH IT? 



27i! 



Mark an X on th£ picture. 



ClouDr White 



Blue 



YeuoM 



Red Cloudy White 



Y£uow Blu£ 
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Table 94 • Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


12-A 
27-B 


79 
95 


1 15 14 70 0 0 
42 17 19 16 0 1 


95 
79 


12 4 4 80 0 0 
53^ 4 18 25 0 0 


• 35 

• 46 


• 62 

• 28 


Control 


12-A 
27-B 


80 
89 


5 5 10 80_ 0 0 
69 10 7 15 0 0 


89 
80 


4 6 9 80 0 1 
76 8 10 6 0 0 


• 30 

• 60 


• 61 

• 60 



Table 95^ Pretest to Posttest Changes 
(The response choice for 12-A is cited firsts) 



Item Pai 


r 12-A, 27-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D A 


A D A+D 


B C B+C 


C B C+B 


Experi- 
mental 

Control 


+10 +6 +9 
0 +7 +4 


+11 +9 +9 
-1 -9 -5 


-11 -1 -3 

+1 +3 +2 


-10 -13 -12 
-1 -2 -1 



teachers of confusion because both the carbon dioxide and oxygen tests 
were presented on the same worksheets Doing the activities on separate 
days and on separate worksheets should eliminate this confusion^ There 
was a mean net gain from pretest to posttest of four percent (from 
74 to 78 percent) for the control group. The pretest- to-posttest gain 
in the control group can be attributed to instruction, but from pretest 
scores it is evident that more students in the control group had prior 
knowledge of testing for carbon dioxide than did the students in the 
experimental group. The change in biserial correlations from pretest 
to posttest confirms the confusion of the experimental group and led 
us to hypothesize that some instruction may have occurred in the control 
group. Colored slides were used for this pair to reinforce the word 
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labels of colors and condensate for students who could not match the 
word with the corresponding color. 



WHAT PART IS THE WINDPIPE? 

Hakk an X in the circle on the line that touches the paot. 



13a what part is THE WINDPIPE'' 

Mark an X in the circle on the line that touches the part. 





Item pair 13-A, 15-B tunctions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 36 percent (from 52 to 88 percent) . This gain can be attrib- 
uted to losses in all other response choices. Mean n3t gain from 
pretest to posttest for the control group was 17 percent (from 49 to 

Table 96. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


13-A 
15-B 


79 
95 


6 22 48 24 0 0 
56, 8 13 23 0 0 


95 
79 


1 4 87 7 0 0 
90 0 3 8 0 0 


.41 
.54 


.52 
.46 


Control 


13-A 
15-B 


80 
89 


32 5 44 19 0 0 
54 11 15 19 1 0 


89 
80 


12 7 65 13 0 2 
6£ 6 lO" 16 0 0 


.39 
.63 


.41 
.68 



Table 97. Pretest to Posttest Changes 
(The response choice for 13-A is cited first.) 



Item Pair 


13-A, 15- 


B 


Percent Change 


/ Pretest 


to Posttest 




Student 
Group 


Correct 
Choice 






Parallel 


Distractor 


Pairs 




C A 


C+A 


A 


C 


A+C 


B 


B 


B+B 


D D 


D+D 


Experi- 
mental 


+39 +34 


+36 


-5 


-10 


-8 


-18 


-8 


-13 


-17 -15 


-16 


Control 


+21 +14 


+17 


-20 


-5 


-12 


+2 


-5 


-1 


-6 -3 


-5 
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66 percent) . The greater pretest-to-posttest gains in the experimental 
group can be attributed to the effect of instruction. The biserial 
correlations indicate that both items are good discriminators. 



WHICH PERSON IS TESTING THE AWOUNT OF CARBON DIOXIDE 
IN INHALED AIR^ 

Mark an X on that person. 



16* WHICH PERSON IS TESTING THE AflOUNT OF OXYGEN IN INHALED AIR'' 19b 

Hark an X on that ftusoN. 





Item pair 16-A, 19-B fxmctions at the cognitive level of analysis. 
Mean net gain from pretest to posttest for the experimental group was 
15 percent (from 34 to 49 percent) . The gain can be attributed to 
losses in all other distractors. For the control group the pretest and 
posttest levels of achievement were both 28 percent. We can attribute 
the gains for the experimental group to the effect of instruction, in 
view of the complexity of the task required in answering this item, a 
49 percent level of achievement is very satisfactory. The biserial 
correlations indicate that both items are good discriminators. 



Table 98. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N , 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


16-A 
19-B 


79 
95 


32 14 28 25 0 0 
35 18 19 27 1 0 


95 
79 


42 15 21 22 0 0 
56 5 13 27 0 0 


.08 
.31 


.33 
.35 


Control 


16-A 
19-B 


80 
89 


26^ 20 30 24 0 0 
22 25 27 18 1 0 


89 
80 


25. 13 26 31 2 2 
31 8 34 28 0 0 


.43 
.30 


.44 
.30 
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Table 99. Pretest to Posttest Changes 
(The response choice for 16-A is cited first.) 



Item Pair 16-A, 19-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor Pairs 




A A A+A 


B B B+B 


C 


C 


C+C 


D D 


D+D 


Experi* 
mental 


+9 +21 +15 


+ 1 -13 -6 


-7 


-6 


-6 


-3 0 


-2 


Control 


"1 +2 0 


-7 -17 -12 


-4 


+7 


+2 


+ 7 +10 


+ 9 



WHAT PART IS THE DIAPHRAW (BREATHlNG-ftlSCLE)? 22a WHAT PART IS THE DIAPHRAGM (BREATHING-PIUSCLE)^ 18b 

«AmC AN X IN TH£ CIRCLE W THC LINE THAT TOWCHtS THE PART., fUpK AN X IN THE CIRCLE ON THE LINE THAT TOUCHES THE PAR > 




Item pair 22-Af 18-B functions at the cognitive lovel of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 22 percent (from 28 to 50 percent) and can be attributed to 
losses on all other response choices. Mean net gain from pretest to 
posttest for the control group was two percent (from 30 to 32 percent) . 
The pretest-to-posttest gain for the experimental group can clearly 
be attributed to the effect of instruction. The biserial correlations 



Table 100. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


22-A 
18-B 


79 
95 


43 2£ 13 19 1 0 
7 31 49 12 1 0 


95 
79 


32 51 6 12 0 0 
3 48 42 6 1 0 


.12 
.15 


.49 
.12 


Control 


22-A 
18-B 


80 
89 


39 31 11 18 1 0 
20 29 36 13 1 0 


89 
80 


38 35 9 16 0 2 
13 29 38 19 1 1 


.52 
.37 


.41 
.59 
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Table 101. Pretest to Posttest Changes 
(The response choice for 22-A is cited first,) 



Item Pair 22-A, 18-B 


Percent Change, Pretest to 


Posttest 




Student 


Correct 
Choice 


Parallel Distractor Pairs 


Group 


B B B+B 


A C A+C 


C A C+A 


D D 


D+D 


Experi- 
mental 


+27 +17 +22 


-11 -7 -9 


-7 -4 -5 


-7 -6 


-6 


Control 


+4 0 +2 


-1 +2 +1 


-2 -7 -5 


-2 +6 


+2 



indicate that both items are good discriminators. The low biserial 
correlation on the Form B posttest is attributed to a student effect 
and not due to item construction, since both items are essentially 
identical. 

WHAT HAPPENS mU YOU EXHALE' 30* WHAT HAPPENS WHEN YOU INHALE' 2Hb 

Nark an X oh the »»>cture,, Mar* an X on the picture. 




Item pair 30-A, 24-B functions at the congitive level of analysis. 
Mean total gain from pretest to posttest for the experimental group 
was three percent (from 24 to 27 percent) . Control group pretest and 
posttest achievement levels remained stable at 29 percent. Although 
small gains were recorded in the experimental group, future testing 
should result in much higher gains if the revised materials are used. 
The use of supporting films and the functioning torso should reinforce 
this sijbject matter. Biserial correlations are exceptionally high, 
indicating that both items are discriminating well between high and 
low achievers in both the experimental and control groups. 
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Table 102. Item Responses and Biserial Correlations 
for Ejqjerimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


30-A 
24-B 


79 
95 


23 33 33 9 3 0 
39 42 14 4 1 0 


95 
79 


20 35 25 20 0 0 
3£ 38 23 5 0 0 


.36 
.38 


.83 
.47 


Control 


30-A 
24-B 


80 
89 


13 31 30 25 1 0 
23 28 33 4 2 0 


89 
80 


25 37 16 21 0 1 
38 41 13 9 0 0 


.22 
.43 


.50 
.38 



Table 103. Pretest to Posttest Changes 
(The response choice for 30-A is cited first.) 



Item Pair 30-A/ 24-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D A D+A 


A D A+D 


B B B+B 


C C C+C 


Experi- 
mental 

Control 


+11 -5 +3 
+4 +5 0 


-3 +1 0 
+12 +5 +9 


+2 -4 -2 

+6 +13 +10 ' 


-8 +9 +1 
^4 -20 -17 



Objective 201 . Students will identify respiration as a necessity 
fQ3^ body action. Five student activities and other instructional 
strategies were designed to develop student competencies to achieve 
this objective. 

For activities 7 and 8, 75 percent of the teachers used the 
strategies as described; 19 percent reported some modification; and 
one teacher replaced the strategies by having students run in place 
instead of doing the pushups as described in the activity. No serious 
problems were encountered in activities 7 and 8. Several teachers 
reported, "Very successful activity. We posted a chart recording their 
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iinprovements in exercises and the carry-over ir attitudes to other siab- 
ject areas Wcis good." 



100 



Percent of 
teachers 
(N=16) 



Interest 


Pleasure 


Willingness 


Disinterest 


Displeasure 


Unwillingness 




75 










L 


L 





543215432154321 

Figure 54. Reaction of the majority of students 
to activities 7 and 8 



100 



Percent 50 




I 



Percent of 
teachers 
(N=14) 



5 4 3 2 1 
Important OK Useless 



Figure 55. Importance to students of activities 7 and 8 



5 = high 
3 = neuti 
1 = low 



100 



Percent 50 




All 3 j, A None 
4 2 4 4 



Figure 56. Proportion of 
students able to perform 
on subobjectives for 
activities 7 and 8 



100 



50 

Percent of 
teachers 
(N=16) 0 




I 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 

Important * OK ■ Useless 

Figure 57. Importance of the 
subobjectives 



Figure 54 shows student reactions to be very high across the three 
rating scales. Both activities were important for EMH students (see 
Figure 55) . Figure 56 shows the proportion of students who were able 
to perform the behaviors specified by the subobjectives for activities 
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7 and 8. Eighty-two percent of tiio. teachers reported that three-fourths 
or more of their students were successful. Figure 57 shows that teachers 
rated uhe subobjectives as being very important for EMH students. 

For activities 9 and 10, 56 percent of the teachers used the 
strategies as described and 44 percent reported some modification. 
The major problem encountered in this series of activities was that 
some teachers used fresh bread soaked in vegetable oil as an energy 
source and it would not burn. These instructions have been changed 
to direct the teachers to use dry bread soaked in vegetable oil and 
leave it overnight before attempting to burn it. This technique was 
used successfully by several teachers cind has been verified by the 
BSCS staff. 



Interest 
Disinterest 



Pleasure Willingness 
Displeasure Unwillingness 



100 



Percent of 
teachers 
(N=16) 



50 




5 = high 
3 = neutral 
1 = low 



5 4 



3215432154321 



Figure 58. 



Reaction of the majority of students 
to activities 9 and 10 



100 



Percent 




Percent of 
teachers 
(N=14) 



5 4 3 2 1 



Important 



OK 



Useless 



Figure 59. Importance to students of activities 9 and 10 
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Figure 58 shows student reactions to be high across the three 
scales. The problems encountered trying to burn fresh bread could 
account for the slightly lower rating than the previous activities 
received. Both activities were judged important for EMH students 
(see Figure 59) . 



Percent 



100 



50 




1 i i <1 NO"® 
4 2 4 4 



Figure 60. Proportion of 
students able to perform 
on subobjectives for 
activities 9 and 10 



100 



50 




Percent of 
teachers 
(N=16) 



5 4 3 2 1 
Important ■ ok Useless 

Figure 61. Importance of the 
subobjectives 



Figure 60 shows the proportion of students who were able to per- 
form the behaviors specified by the subobjectives for activities 9 and 
10. The lower success rate is attributed to the problems encountered 
in burning bread in activity 9, which was a basis for several conclu- 
sions which jshould have been drawn by the students. Student performance 
on each individual svibobjective supports this conclusion, since student 
success was high on all other subobjectives. Figure 61 shows that 
teachers rated the svibobjectives as being very important for EMH 
students. Teachers who marked the "2" were some of the ones who en- 
countered difficulties with the activity. 

For activity 11, 75 percent of the teachers used the strategies 
as described? 19 percent reported some modifications? and six percent 
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reported much modification. This sequence of slides was designed to 

help bring the circulatory, respiratory and digestive systems together, 

but two problems were encountered. First, as was the case with the 

oxygen and carbon dioxide test worksheets, it appears that too much 

has been presented at once on the activity 11 worksheet. The sequence 

was revised to present the slides in two activities instead of one. 
The second problem was a matter of modifying artwork on the slides. 

Lungs and diaphragm were added and the digestive system was darkened 

to help students distinguish between intestines, windpipe and blood 

vessels. 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N=16) 



100 



50 



543215432154321 

Figure 62. Reaction of the majority of students 
to activity 11 

100 



Percent 50 




I 



5 4 3 2 1 
Important ■ OK ^ Useless 



Perceiit of 
teachers 
(N=12) 



5 = high 
3 = neutral 
1 = low 



Figure 63. Importance to students of activity 11 

Figure 62 shews student reactions to be high across the three 
rating scales, but the problems encountered lowered the ratings some- 
what from the previous activities. The activity was judged to be 
important for EMH students (see Figure 63) . 
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100 



Percent 50 - 




100 



50 



Percent of 
teachers 
(N=16) 




I 



All 3 1 1 1 None 
4 2 4 4 



Figure 64. Proportion of 
students able to perform 
on subobjectives for 
activity 11 



Percent of 
teachers 
(N=15) 



Important 



5 4 3 2 1 
OK ■ Useless 



Figure 65. Importance of tlie 
subobjectives 



Figure 64 shows the proportion of students who were able to per- 
form the behaviors specified by the subobjectives for activity 11. 
This figure is slightly skewed because one of the subobjectives deals 
with student knowledge before seeing the slides. In spite of this 
and minor problems with the slides themselves, 87 percent of the teachers 
reported that one-half or more of their students were able to perform 
the desired behaviors. Figure 65 shows that teachers ranked the sub- 
objectives much higher than those of previous activities. 



Ten item pairs were designed to sample achievement on objective 



201. 

WHAT MOVES YOUR LEGS WHEN YOU MMV 
Har« an X ON youp choice. 



BLOOD 



AIP 



M'JSCLES 



FOi:' 



WHAT MOVES YOUR ARM WHE»' YOU THROW A BALL' 
Hark an X on your chojce. 

MUSCLES 



23b 



HEART 



LUNGS 



3 ^^Q"^^" j 



ERLC 



Item pair 1-A, 23-B is a baseline item and functions at the cog- 
nitive level of knowledge. Mean net gain from pretest to posttest for 
the experimental g-oup was 16 percent (from 71 to 87 percent). This 
gain can be attributed to losses in all other response choices. Thtixe 
was a mean net gain of six percent (from 75 to 81) in the control group. 
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Table 104. Item Responses and Biserial Correlations 
for Experimental cind Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttes t 




N 


Percent of N 


N 


Percent of N 


A B C D M <^ 


A B C D M 0 


Pre 


Post 


Ejcperi- 
mental 


1-A 
23-B 


79 
95 


22 4 70^ 5 0 0 
12 8 72 7 1 0 


95 
79 


2 1 92_ 5 0 0 
5 8 82 4 1 0 


.38 
.41 


.62 
.57 


Control 


1-A 
23-B 


80 
89 


11 10 68 10 0 1 
6 6 81 7 1 0 


89 
80 


11 8 75^ 4 1 0 
4 5 88 4 0 0 


.44 
.28 


.46 
.63 



Table 105. Pretest to Posttest Changes 
(The response choice for 1-A is cited first.) 



Item Pai 


r 1- 


•A, 23-B 


Percent Change, 


Pretest to 


Posttest 




Student 


Correct 
Choice 


Parallel 


Distractor Pairs 




Group 


C 


C C+C 


A A A+A 


B 


B B+B 


D D 


D+D 


Experi- 
mental 


+22 


+10 +16 


-20 "7 "14 


"3 


0 "2 


0 -3 


-1 


Control 


-r7 


+7 +6 


0 -2 0 


-2 


"1 "1 


•6 -3 


-4 



The greater gains and higher posttest achievement level of the experi- 
mental group enable us to attribute the success of the experimental 
group to the effect of instruction. The biserial correlations indicate 
that the items are good discriminators. 



WHICH PERSON HAS RUN IHE HOST? 

MAftK AN X ON THAT K((SON. 



5a Of THi FOLLOWING HAS jy^T HNISHEL STRENliOUS EXfPClSE'' 

lAOk „N ^ ON TMA P£W50f*, 





30 

ftREATHS 
IN OHt 
MJNUTC 
D 



H 

b«EATHS 
IN 0N£ 
MlNUTt 



20 

BRE/ThS 
IN ONE 
MlNUTt 



18 

KPEAThS 

IN ONt 
HI NUT t 



IS 

KRtATHS 
IN ONL 
MlNUTE 



Item pair 5~A, 12-B is a baseline item and functions at the cog- 



nitive level of comprehension. Mean net gain from pretest to posttest 
for the experimental group was nine percent (from 72 to 81 percent) . 
This gain can be attributed to a shift from all other response choices. 
The control group registered a mean net loss of three percent from 
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Table 106. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


i2-B 


79 
95 


9 1 11 78 0 0 
6£ 7 6 19 1 0 


95 
79 


6 4 5 84 0 0 
78_ 10 5 6 0 0 


.41 
.45 


.39 
.65 


Control 


5 -A 
12-B 


80 
89 


0 0 4 96 0 0 
6£ 11 9 10 1 0 


89 
80 


2 2 4 89 1 1 
69 4 5 23 0 0 


.43 
.48 


.73 
.18 



Table 107. Pretest to Posttest Changes 
(The response choice for 5-A is cited first.) 



Item Pair 5-A, 12-B 


Percent Change, 


Pretest to 


Posttest 




Student 


Correct 
Choice 


Parallel 


Distractor Pairs 




Group 


D A D+A 


A D A+D 


B 


C 


B+C 


C B 


C+B 


Experi- 
mental 


+6 +12 +9 


-3 -13 -8 


+ 3 


-1 


0 


-6 +3 


"2 


Control 


"7 0 -3 


+ 2 +13 +8 


+2 


-4 


-2 


0 -7 


-4 



pretest to posttest, allowing \is to attribute the experimental group 
gains to the effect of instruction. The pretest level of achievement 
indicates that most EMH students in our sample had prior knowledge of 
the relationship of breathing rate and exercise. This does not mean, 
however, thar they understand the reason for the relationship. Bi- 



serial correlations indicate that both items are good discriminators. 

in WHAT PART DOCS OXYGEN FROM THE AIR GO INTO THE BLOOD'> ISa Ul WHAT PAPT DO- S CAPBON DIOXIDE GO OUT OP THE BLOOD'> 

HaUK an X IN THt CFRCLt ON THE LINE THAT TOUCHSS THE P ..n. *^ ^ ^""^ ^^^'^^^ '■"'^ T"*^ TOUCHES THE PAPT., 




Item pair 15-A, 5-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 12 percent (from 53 to 65 percent) . The gain can be attrib- 
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Table 108. Item Responses and Biserial Correlations 
for Ejcperimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


15-A 
5-B 


79 
95 


4 19 67 9 0 1 
3 36 3£ 22 1 0 


95 
79 


5 14 62 14 0 0 
5 15 £2 18 0 0 


.50 
.42 


.37 
.62 


Control 


15-A 
5-B 


80 
89 


10 10 71 6 3 0 
8 34 45 13 0 0 


89 
80 


13 19 51 13 1 2 
13 35 43 10 0 0 


.23 
-28 


.07 
.41 



Table 109. Pretest to Posttest Changes 
(The response choice for 15-A is cited first.) 



Item Pair 15-A, 5-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C C C+C 


A A A+A 


B ' B B+B 


D D D+D 


Experi- 
mental 

Control 


0 +24 +12 ■ 
-20 -2 -11 


+1 +2 +2 
+3 +5 +4 


-5 -21 -13 
+9 +1 +5 


+5 -4 0 
+ 7 -3 +2 



ERIC 



uted to losses in all response choices except A in both forms / the wind- 
pipe, where pretest-to-posttest gain of two percent (from three to five 
percent) was recorded. Although total percent is small, this minor prob- 
lem should be eliminated by the functioning torso in the revised materials* 
There was a mean net loss of 11 percent (from 58 to 47 percent) from pre- 
test to posttest in the control group. The pretest-to-posttest gain in 
the experimental group can be attributed to the effect of instruction. 
The biserial correlations show that both items are good discriminators. 

1;a what combines WITH OXYGEN IN THE MUSCIi TO RELEASE 17s 



WHAT COMBINES MITH FOOD IN THE HUSCLE TO RELEASE 
ENERGY: CARBON DIOXIDE. OXYGEN, WATER. DIGESTIVE JUICE. 

HaKK an X ON YOUK CHOICE. 



CARBON 
DIOXIDE 



OXYGEN 



WATER 



1 



DIGESTIVE 
JUICE 

0 



WHAT COMBINES WITH OXYGEN IN THE MUSCLE TO RELEASE 
ENERGY- CARBON MOXIDE. WATER. DIGESTIVF JUICE., FOOD. 



Mark an X on your choice. 



CARBON 
DIOXIDE 





WATER j 


DIGESTIVE 
JUICE 




FOOD 




c 


D 



Item pair 17-A, 17-B functions at the cognitive level of knowledge. 
Mean total gain from pretest to posttest for the experimental group 
was ten percent (from 31 to 41 percent) . The gain can bo accounted 
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Table 110. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


17-A 
17-B 


79 
95 


10 291 20 39 1 0 
28 15 25 32^ 0 0 


95 
79 


19 15 21 25 0 0 
25 11 14 48 1 0 


.27 
.30 


.33 
• 54 


Control 


17-A 
17-B 


80 
89 


13 21 16 48 3 0 
28 16 30 25^ 1 0 


89 
80 


16 19 19 43 2 1 
23 11 34 33 0 0 


• 30 
.06 


.02 
• 10 



Table 111. Pretest to Posttest Changes 
(The response choice for 17-A is cited first.) 



Item Pair 17-A/ 17-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B D B+D 


A A A+A 


C B C+B 


D C D+C 


Experi- 
mental 

Control 


+6 +16 +10 
-2 +8 +3 


+9 -3 +3 
+3 -5 -2 


+1 -4 -1 
+ 3 -5 -1 


-14 -11 -12 
-5 +4 0 



for by losses from all other response choices except carbon dioxide, 
where a slight gain was noticed. The gain from pretest to posttest 
for carbon dioxide on Form A of nine percent came mainly from one 
class where the teacher was confused and modified the teaching strate- 
gies. The relatively low level of posttest: achievement confirms the 
feedback from teachers that the worksheet in activity 11 should become 
two worksheets dealing with two separate activities. The mean total 
gain from pretest to posttest for the control ayoup was three percent, 
allowing us to attribute the e5q)erimental group gains to the effect of 
instruction. Biserial correlations were much higher for the experi- 
inental group than for the control group, confirming the effect of 
instruction. 
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WHERE DOES BLOOD PICK UP FOOD' 



Hark an X in the circle at the end of the line that 

TOUCHES THE PART. 



hH£RE doe: food ENTER THE BLOOD' 



13b 




Mar^ m X IN The circle at the end of tme line that 

TOUCHES The P*rT., 




Item pair 18-A, 13-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest for the experimental 
group was three percent (from 41 to 44 percent) . This gain is accounted 
for by a loss from choosing the heart. These results confirmed the 
need to strengthen activity 11 to bring the relationship botween the 
digestive and circulatory systems into a sharper focus. Mean total 
gain from pretest to posttest for the control group was four percent 
(from 21 zo 25 percent) . Although the posttest level of achievement 
of the experimental group was higher than that of the control group, 
the pretest level was also higher. A note was added to the Teacher's 

Test Administration Guide and Answer Key that this pair of items can 
help the teacher identify those students who are having difficulties 

identifying and separating the roles of the heart, stomach and intes- 
tines. Although the pretest-to-posttest gains of the experimental 



Table 112. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


18-A 
13-B 


79 
95 


22 38 10 30 0 0 
32 5 44 19 0 0 


95 
79 


25 39 10 25 0 0 
23 13 49 15 0 0 


.42 

.39 


.58 

53 


Control 


18-A 
13-B 


80 
89 


41 19 4 34 3 0 
30 7 22_ 39 1 0 


89 
80 


33 27 3 35 0 2 
35 4 22 39 0 0 


.17 
.01 


.03 
.14 
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Table 113. Pretest to Posttest Changes 
(The response choice for 18-A is cited first.; 



Item Paj 


Lr 18-A, 13-B Percent Chanqe, Pretest tn Pnct-^-oo*. 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A D+A 


Experi- 
mental 

Control 


+1 +5 +3 
+8 +1 +4 


+3 -4 0 
-8 0 -4 


0 +8 +4 
-1 -3 -3 


-5 -9 -7 
+1 +5 +3 



and control groups are very similar, the biserial correlations clearly 
indicate an instructional effect in the experimental group. 



WKlCh D0£5 m? BODY USE: FOP [N£»GY? 

flA«K AN X ON VOUfi fHOlCt. 



O 



Battea/ 



Watlp 



WHICH DO£S YOUR BODY USE FOf? iumv 

A\ X CN VOUR CHOICE. 





BATTERy 



Water 



Item pair 19-A, 4-B fionctions at the cognitive level of knowledge. 
There was a mean total loss from pretest to posttest for the experi- 
mental group Of four percent (from 11 to seven percent) . The control 
group registered a mean total qain of 11 percent (from eight to 19 
percent). Several problems were identified here. First, student inter- 
views verified that syrup was thought of as a condiment and not an 
energy source, which led to using cookies in both Forms A and B as the 
correct response choice. A drastic shift occurred in the experimental 
group from choosing water as an energy source on the pretest to choos- 
ing oxygen as the energy source on the posttest. The materials were 
revised to clarify the roles of food and oxygen in producing energy. 
The gain in scores and increase in biserial correlations for the 
control group indicate that instruction on this topic probably did 
occur in several of the control group classes. 
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Table 114, Item Responses and Biserial Correlations 
for Ej^erimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


19-A 
4"B 


79 
95 


1 34 57 8 0 0 
33 13 1 54 0 0 


95 
79 


7 26 59 2 0 0 
70 8 3 20 0 0 


-.01 
.16 


.04 
-.04 


Control 


19-A 
4"B 


80 
89 


3 31 56 9 1 0 
31 8 3 56 1 0 


89 
80 


2 3C 43 24 0 1 
29 13 9 50 0 0 


-.17 
.05 


.71 
.27 



Table 115. Pretest co Posttest Changes 
(The response choice for 19-A is cited first.) 



Item Pa. 


Lr 19-A, 4-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D B D+B 


A C A+C 


B D B+D 


C A C+A 


Ea^eri- 
mental 

Control 


-1 -5 -4 
+15 +5 +11 


+6 +2 +4 
-1 +6 +2 


"8 -34 -21 
-1 -6 -4 


+2 *-37 +19 
-13 -2 -7 



WHICH BOY IS USING THE HOST OXYG£N? 

flA»K AN X ON THE MY OF YOUH CHOICE. 




I 



25a which girl IS EXKALIftG THE MOST CARBON DIOXIDE? 

flA«K AN X ON THE GtKL OF YOUH CHOICE. 






Item pair 23-A, 14-B is a baseline item and functions at the cog- 
nitive level of comprehension. Mean total gain from pretest to post- 
test for the experimental group was 18 percent (from 72 to 90 percent) . 
The gain can be accounted for by losses from all other response choices. 
Mean total gain for the control group was five percent (from 70 to 75 
percent) . A comparison of the experimental- control group gains enabled 
us to attribute experimental group gains to the effect of instruction. 
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Table 116. item Responses and Biserial Correlations 
for E^erimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of M 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


23-A 
14-B 


79 
95 


1 14 3 81. 1 0 

2 26 8 62 0 0 


95 
79 


1 6 1 22 0 0 
3 6 4 87 0 0 


.39 
.35 


.19 
.87 


Control 


23-A 
14-B 


80 
89 


0 16 3 8]^ 0 0 
4 34 1 60_ 1 0 


89 
80 


0 15 2 81 1 1 
4 23 5 69 0 0 


.38 
.30 


.48 
.51 



Table 117. Pretest to Posttest Changes 
(The response choice for 23-A is cited first.) 



Item Pa. 


Lr 23-A, 14-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


D D D+D 


A A+A 


B B B+B 


C C C+C 


Eyperi- 
juental 

Control 


+11 +24 +18 
0 +9 +5 


0+10 
0 0 C 


-8 -20 -14 
"1 -11 -6 


"2 -4 -4 
"1 +4 +1 



The relationship between body exercise and exhaling carbon dioxide is 



clearly established. Biserial correlations indicate that both items 
are good discriminators. 

IN WHAT PART DOES OXYGEN FROH THE AIR GO INTO THE BLOOD' 2^^* IN «HAT PART DOES CARBON DIOXIDE GO OUT OF THE BLOOD' 

fUHK AN X IN THE CIRCLE ON THE UHt TM*T TOUCHES THE MRT, f^tRK AN X IN THE CIRCLE ON THE LINE THAT TOUCHES THE PART. 




Item pair 24-A, 22-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest for the experimental 
group was 18 percent (from 28 to 46 percent) • This gain can be 
accounted for by losses from all other response choices, except the 
mouth. Mean total gain for the control group was seven percent (from 
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23 to 30 percent). The experimental group gain is attributed to the 
effect of instruction. Biserial correlacions indicate that both items 
are good discriminators. 



Table 118. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


24-A 
22-B 


79 
95 


20 35 22 22 1 0 
16 21 12 52 0 0 


95 
79 


26 49 15 9 0 0 
16 42 13 29 0 0 


.55 
.20 


.40 
.28 


Control 


24-A 
22-B 


80 
89 


15 29_ 33 23 1 0 
13 18 24 42 3 0 


89 
80 


11 33. 36 18 1 1 
18 26 23 34 0 0 


.43 

.15 


.39 
.28 



Table 119. Pretest to Posttest Changes 
(The response choice for 24-A is cited first.; 



Item Pair 24-A, 22-B 




Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Distractor Pairs 




B B B+B 


A 


A A+A 


C 


C 


C+C 


D D 


D+D 


Experi- 


















mental 


+ 14 +21 +18 


+6 


0 +3 


-7 


+ 1 


-3 


-13 -23 


-18 


Control 


+4 +8 +7 


-4 


+ 5 0 


+ 3 


-1 


+2 


"5 -8 


-7 



WHAT i:: PFMOvtD thi blood at this toint 
mni. DiG^sTivr jtJict. mm. 

DIGFSTLD FOOD'' 




•lAftK AH X ON yOUP CmOICC. 



UPINE 



DIGESTIVE 
JUICE 



WATER 



DlGFSTrO 
FOOD 



WHAT IS mom FROM THE BLOOD AT THIS POINT 
CA«BON DIOXIDE. DIGESTIVE JUICE, 
STARCH, URINE-^ 




Mark an X on youn choicc,. 



CARBON 
DIOXIDE 



DIGESTIVE 

Jl[ICE_ 



' STARCH 



URINE' 



Item pair 26-A, 30-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest for the experimental 
group was 14 percent (from 21 to 35 percent) . There was a mean net 
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loss of four percent (from 19 to 15 percent) for the control group* 
We can already attribute experimental group gains to the effect of 
instruction. We believe that the posttest success level will be much 
higher with the use of supporting films and the functioning torso with 
the revised materials. Biserial correlations are very good for the 
experimental group. 



Table 120. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


26-A 
30-B 


79 
95 


18 25 20 34 3 0 
22^ 33 26 16 3 0 


95 
79 


21 22 24 33 0 0 
47^ 20 16 14 3 0 


.34 
.89 


.41 
.74 


Control 


26-A 
30-B 


80 
69 


21 19 12 45 3 0 
25^ 36 22 12 4 0 


89 
80 


19 21 9 47 2 1 
21. 23 29 28 0 0 


-.16 
.18 


-.10 
.30 



Table 121. Pretest to Posttest Changes 
(The response choice for 26-A is cited first.) 



Item Pair 26-A, 30-B 


Percent Change, Pretest to 


Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C A C-fA 


A D A+D 


B B B+B 


D C D+C 


Experi- 
mental 

Control 


+4 +25 +14 
-4 -4 -4 


+3 -2 +1 
-2 +16 +7 


-3 -13 -8 
+2 -13 -6 


-1 -10 -6 

+2 +7 +5 


Item pair 28-A, 28-B functions at the 


cognitive level of compre- 



hension. Mean total gain from pretest to posttest for the experimental 
group was 16 percent (from 43 to 59 percent) . This can be accounted 
for by losses from all other response choices. Mean total gain for 
the control group was six percent (from 46 to 52 percent). The 
experimental group gains are attributed to the effect of instruction. 
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Although students readily associate carbon dioxide with exhaled air 
and recognize its relationship to exercise, it appears that approximately 
one- third do not yet know that carbon dioxide enters the lungs from 
the blood. The more detailed reviews should improve this situation. 



Table 122. item Responses and Biserial Correlations 
for E^-perimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


28-A 
28-B 


79 
95 


11 6 25 52 5 0 
32 S£ 13 17 5 0 


95 
79 


8 13 21 57 1 0 
18 62 13 4 4 0 


.39 
.54 


.61 
.70 


Control 


28-A 
28-B 


80 
89 


13 6 25 53 4 0 
13 40 31 11 3 0 


89 
80 


9 6 28 54 2 1 
19 49^ 18 14 1 0 


.48 

.59 


.45 
.59 



Table 123. Pretest to Posttest Changes 
(The response choice for 28-A is cited first.) 



Item Pa J 


ir 28-A, 28-B Percent ChanM . Pvot-^c*. ^-^ n^^4.4.^^4. 


btudent 
Group 


Correct- 
Choice 


Parallel Dis tractor Pairs 


D B D+B 


A C A+C 


B D B+D 


C A C+A 


Experi- 
mental 

Control 


+5 +28 +16 
+1 +9 +6 


-3 0 -2 
-4 -13 -9 


+7 -13 -3 
0 +3 +1 


-4 -14 -9 

+3 +6 +4 
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Objective 202 . Students will infer a relationship between waste 
and internal body processes . Five student activities and other instruc- 
tional strategies were designed to develop student competencies to 
achieve this objective. 

FDr activities 12 and 13, 81 percent of the teachers used the 
strategies as described; 19 percent reported some modifications. 
Ninety-three percent of the teachers reported that the strategies were 
successful. A minor problem occurred when teachers attempted to burn 
bread with cooking oil, but this was simply a repeat of an earlier 
problem that most teachers had already overcome. Many positive comments 
were received concerning these two activities, such as, "When discussing 
elimination we invariably get on the s^jbject of personal hygiene. My 
student teacher overheard two of the boys seriously and privately dis- 
cussing what they should do about 'teaching* #3101 how to clean himself 
in the bathroom — a day or two later one of the boys told me that they 
K had taken it upon themselves to teach 3101 how to care for himself. 

The results are positive. My hope is that they will be lasting." 

Figure 66 shows that student reactions were high across the three 
rating scales. Figure 67 shows that both activities were considered 
to be important for EMri students. Eighty-fivo percent of the teachers 
estimatf^d that one-half or more of their students were able to perform 
the behaviors specified by the subobjectives , and they judged the sub- 
objectives to be very iirportant (Figures 68 and 69). Again, it is 
interesting to note that the teacher who did not follow the strategies 
reported the lowest success level for her students. 

O 

ERLC 
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Percent of 
teachers 
(N=16) 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



50 - 




543215432154321 
Figure 66. Reaction of the majority of students 
to activities 12 and 13 



5 = high 
3 = neutral 
1 = low 



100 



Percent 50 




I 



Percent of 
teachers 
(N=15) 



5 4 3 2 3 



Important 



-OK- 



Useless 



Figure 67. Importance to students of activities 12 and 13 



100 



Percent 50 - 44 



iLi 



100 



50 



All 3 1 1 1 None 
4 2 4 4 



Figure 68. Proportion of 
students able to perform 
on subob jectives for 
activities 12 and 13 




I 



6 ^ 

5 4 3 2 1 
Important OK Useless 

Figure 69. Importance of the 
sub objectives 



Percent of 
teachers 
{N=16) 



For activities 14 and 14a optional, 75 percent of the teachers 
reported that they used the strategies as described; 25 percent reported 
some modifications. Three problems were encountered with activities 14 
and 14a. First, too much subject matter is contained in activity 14. 
This has been split up into three different ac-ivities in the revised 
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materials. Second, the kidney model made from the tin can was trouble- 
some for some teachers, but rc^finements have been made and the model 
now works very well. Third, the colored dots on the daylight slides 
representing urine, blood, etc. were difficult to distinguish by some 
students. The dots have now been changed to triangles and more vivid 
colors have been used- The success of optional activity 14a (dissect- 
ing a real kidney) has led to the inclusion of t:his as a regular activity. 
A review activity has been added to help the students better understand 
the "gestalt" of this series of activities. The functioning torso that 
is available with the commercial edition will greatly enhcince not only 
these activities, but the entire instructional sequence. 

One teacher's comment should be included here: "Children are 
very proud of their attitude toward science. We have not had any 
problems with embarrassment over bodily functions in this unit. Their 
interest in showing others the new vocabulary they are learning has 
prompted the use of appropriate terminology rather than slang terms." 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N=16) 



100 



50 - 




5 = high 
3 = neutral 
1 = low 



543215432154321 

Figure 70. Reaction of the majority of students 
to activities 14 and 14a. 



Figure 70 shows that students reactions were high across the three 
rating scales. Figure 71 shows that both activities were considered 
to be important for EMH students. Sixty- four percent of the teachers 
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100 



Percent 50 



64 



I 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 
Important ——OK ^ Useless 



Figure 71. Importance to students of activities 14 and 14a 



100 



Percent 50 











27 ■ 


23 




[ ^ ^ _2 



100 



50 - 




I 



Percent of 
teachers 
(N=16) 



2 i i <i No"® 
4 2 4 4 



Figure 72. Proportion of 
students able to perform 
on subobjectives for 
activities 14 and 14a 



5 4 3 2 1 
Important OK Useless 

Figure 73. Importance of the 
SMbobjectives 



estimated that three-fourths or more of their students were able to 
perform the behaviors specified by the fcijbobjectives ; 87 percent esti- 
mated that one-half or more of their students could perform successfully 
(see Figure 72) , Figure 73 shows that the objectives were considered 
to be iirportant. 

For activity 15, 75 percent of the teachers reported that they 

used the strategies as prescribed; 25 percent reported some modifications. 
Seventy-five percent reported that the strategies were successful. Some 
minor problems were encouiitered in interpreting the slides of the skin 
cross-section, but most were overcome by student-teacher dialogue. 
The application extensions to the activities continue to prove very 
effective, as is clear from the following feedback: "The discussions 
relating to the hygienic aspects were lengthy, rewarding and involved 
all the children. The kids always like to apply knowledge gained from 
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the 'scientific' approach and relate their personal e5Q>eriences. By 
the way — #3101 shows great improvement in his personal hygiene and 



influence (pressure) is paying off. 

"On the day we were using this activity a boy 'skinned' his knee. 
He peeled off some loose skin and it was a perfect example. I would 
not recommend it as a prescribed procedure — but the coincidence was 
great and good therapy for the victim." 

Figure 74 shows that, student reactions were high across the three 
rating scales. Figure 75 shows that activity 15 was considered extremely 
important for EMH students. Figure 76 shows that 58 percent of the 
teachers estimated that three- fourths or more of tneir students could 
successfully perform the behaviors specified; 80 percent reported that 



I attribute much of this gain to our study. This ~ coupled with peer 



Interest 
Disinterest 



Pleasure Willingness 
Displeasure Unwillingness 



100 



Percent of 
teachers 
(N=16) 




5 = high 
3 = neutral 
1 = low 



543215432154321 

Figure 74. Reaction of the majority of students 
to activity 15 
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Figure 75. Importance to students of activity 15 
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100 



Percent 50 
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20 ■ 


22 
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100 



50 




I 



All 3 1 1 A None 
4 2 4 4 



Figure 76. Proportion of 
students able to perform 
on subobjectives for 
activity 15 



5 4 3 2 1 
Important OK Useless 

Figure 77. Importance of the 
subobjectives 



Percent of 
teachers 
(N=16) 



one-half or more of their students were successful. Figure 77 shows 
that the subobjectives were also judged to be very important. 

Eight item pairs were designed to assess achievement on objective 

202. 



HHICH mton WA3 ?10ST fiCTIvL' 

"AOir Afi X ON THAT PE** 



The rriLLOHiNG peb^cns aol i/^a^in'' in"*'^ carbon 

vrOCt TEST SOLUTION, 

wMCH mm m i(i3t ^nwr 

**Otf AN > CN TMA' ftRSCH, 



IN IS 'Auu: 

i 





IN 2S seconlps 



Turned CLOUDY WHITE TupNE^ CLOOTIV ^^hHE Tuf<NED CLOU^• «h!TE TupNE: C.OUDy HMITE j^j,,^. Tu'NEL CLO'JDV, WHITE Tupr^EL r.OUr< W-lTt TUPSES CLOUD' ^Hl 



IN 10 5£C0NDS 



\U 2S SECOND 



IN 20 SECONDS 



IN 'ECrNDi 




IN 1; SffOf«DS 

^'vJ-j 

'ft ^ 

>\ A 



Item pair 3-A, 8-B functions at the cognitive level of analysis. 
Mean net gain from pretest to posttest for the experimental group was 
12 percent (from 28 to 40 percent) . This gain resulted from losses 
from all distractor pairs except D on Form A and A on Form B, where 
gains of four percent each were recorded. It is evident from these 
results that some students are having problems relating the time 
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Table 124. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 

# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


3-A 
8-B 


79 
95 


30^ 22 18 30 0 0 
37 19 17 27 0 0 


95 
79 


42^ 17 7 34 0 0 
41 13 8 38 1 0 


.41 
.16 


.35 
.69 


Control 


3"A 
8-B 


80 
89 


25^ 9 11 53 3 0 
45 11 16 27 1 0 


89 
80 


3£ 13 11 40 0 1 
41 11 8 40 0 0 


.22 
.29 


.59 
.29 



Table 125. Pretest to Posttest Changes 
(The response choice for 3-A is cited first.: 



Item Pa 


ir 3-A, 8-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


A D A+D 


B C B+C 


C B C+B 


D A D+A 


Experi- 
mental 

Control 


+12 +11 +12 
+9 +13 +11 


-5 -9 -6 
+4 -8 -2 


-11 -6 -9 
0 0 0 


+4 +4 +3 
-13 -4 -9 



elapsed with carbon dioxide content of the breath. The three modifi- 
cations mentioned earlier should rectify this problem: counting breaths 
instead of time, separating oxygen and carbon dioxide test worksheets, 
and separating the testing activities on different days with a strength- 
ened review at the end of the activities. Mean net gain for the control 
group was 11 percent .'from 26 to 37 percent), which is very similar to 
the achievement levels of the experimental group. Biserial correlations 
for both the experimental and control groups improved from pretest to 
posttest which, together with achievement levels, led us to hypothesize 
that instruction on this topic occurred within the control group. 

Item pair 4-A, 6-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest for the experimental group was 
38 percent (from 14 to 52 percent) . This gain can be accounted for by 
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THE BLADDER IS USED FOR HOLilNO., CLfANINO.. PUHP1N0. N1X1N5' t. THE 6UDDER IS USED SS A PW., HlxER., HOLDER., CLEANER? 

Hark an X on YOyR Choice. ^j^^^ ^ , 



> ON ycuR Choice. 



HOLDING 




CLEANING 


1 PUHPING 

i 








B 







niXER 



! HOlDER 
I 



CLEANER 



Table 126. item Responses and Biserial Correlations 
for Ej^eriinental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of K 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


6-B 


79 
95 


12 19 37 32 0 0 
42 20 15 23 0 0 


95 
79 


42 22 19 17 0 0 
18 8 6_2 11 1 0 


.29 
-.09 


.71 
.60 


Control 


4-A 
6-B 


80 
89 


14 20 40 26 0 0 
33 11 28 27 1 0 


89 
80 


29 17 40 10 2 1 
33 14 28 25 1 0 


.40 
.13 


.61 
.74 



Table 127. Pretest to Posttest Changes 
(The response choice for 4-A is cited first.) 



Item Pa] 


Lr 4"A, 6"B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A C A+C 


B D B+D 


C A C+A 


D B D+B 


Experi- 
mental 

Control 


+29 +47 +38 
+15 0 +8 


+3 "12 "4 
-3 "2 "3 


-18 -24 -21 
0 0+1 


-15 -12 -13 
-10 +3 -6 



losses on all other response choices. Mean total gain for the control 
group was eight percent (from 21 to 29 percent). Substantial improve- 
ment in biserial correlations from pretest to posttest and the excel] . .it 
gains in the experimental group mean scores enable us to attribute these 
gains to the effect of instruction. 
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Item pair 6-A, 2-B functions at the cognitive level of knowledge, 
Mean net gain from pretest o posttest for the experimental group was 
20 percent (from 60 to 80 percent) and can be accounted for by losses 
on all other response choices. Mean net gain for the control group 
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Sweat glands are found in the- heart,, bladder, skin, stohach 6a 

Hark an X on your choke. 



SWtAT GLANDS ARE FOUND IN THE TONGUE. <1DN£Y. LUNGS. SKIN 

^ARK AN X ON VOUir CHOICE. 



HEART 



BLADDER 



SKIN 



STOflACH 



TONGUE 



klDNEY 



LUNGS 



SKIN 



was four percent (from 61 to 65 percent), enabling us to attribute 
experimental group gains to the effect of instruction. Improvements 
in biserial correlations from pretest to posttest add credence to this 
decision. 

Table 128. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


6-A 
2-B 


79 

95 


5 15 63^ 16 0 0 
12 12 18 58 1 0 


95 
79 


3 9 83 4 0 0 
6 9 9 76 0 0 


.25 
.46 


.62 
.84 


Control 


6-A 
2-B 


80 
89 


8 10 70^ 11 0 1 
8 18 22 5£ 0 0 


89 
80 


9 9 60 21 0 1 
6 10 13 70 1 0 


.45 
.27 


.61 
.56 



Table 129. Pretest to Posttest Changes 
(The response choice for 6-A is cited first.) 



Item P?j 


ir 6-A, 2-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C D C+D 


A C A+C 


B B B+B 


D A D+A 


Experi- 
mental 

Control 


+20 +18 +20 
"10 +18 +4 


"2 -9 -6 
+ 1 -9 -4 


-6 -3 "4 
"1 "8 ~5 


-12 -6 -9 
+10 -2 +5 
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Item pair 7-A, 11-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest for the experimental 
group was 13 percent (from 72 to 85 percent). Mean net gain for the 
control group was five percent (from 68 to 73 percent) . The experi- 
mental group gains were very encouraging and were attributed to the 
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WHICH OF TH[ FOLLOWING WORKS HOST LIKE YOUR BUDDEP'' 
Map* as / os tm£ picture you CmOOSE. 



•f-u- OP T-t FOLLOWING WORr.S LIKE YOUP BLADDEP'' 



effect of instruction. Biserial correlations for both the experimental 
and control groups were excellent. 

Table 130. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



St. udent 
Group 


Item 

# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


r 


b 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


7-A 
11-B 


79 
95 


9 76 10 4 1 0 
9 8 12 69 1 0 


95 
79 


4 85 4 6 0 0 
0 0 15 85 0 0 


.53 
.27 


. 35 
.37 


Control 


7-A 
11-B 


80 
89 


8 70 11 10 1 0 

9 7 17 65_ 2 0 


89 
80 


2 75 10 10 1 1 
8 3 19 71 0 0 


.50 
.44 


.59 
.63 



Table 131. Pretest to Posttest Changes 
(The response choice for 7-A is cited first. 



Item Pair 7-A, 11- 


B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor Pairs 




B D 


B+D 


A B A+B 


C 


C 


C+C 


D A 


D+A 


Experi- 
mental 


9 +16 


+13 


-5 -8 -6 


-6 


+ 3 


-2 


+2 -9 


-4 


Control 


+ 5 +6 


+5 


-6 -4 -5 


-1 


+2 


0 


0 -1 


0 



Item pair 14-A, 9-B functions at the cognitive level of compre- 
hension. There was a mean net loss of two percent (from 63 to 61 per- 
cent) from pretest to posttest for the experimental group. The reason 
for this is that this pair of items was geared to an activity that has 
been removed from the instructional sequence. There was a mean net 



151 



WHAT HOUtli YOU USE TO FIND OUT IF ENIPGY -<AS GlVEN OFF FROM JJ^a M WOUL: YO, uSl TO FlNL OL'T IF ium HAS GIVEN OFF FROM 



flARK AN X ON THE PICTURE YOU CHOOSE. 




AN .« Z'i The P'CTUffE '^U ChOOSE 




gain of eight percent (from 60 to 68 percent) for the control group • 
Pretest levels indicate that approximately two-thirds of the students 
in our Scunple understand the relationship between energy and heat. 

Table 132. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 

# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


14-A 
9-B 


79 
95 


6 6 16 71 0 0 
21 19 5_5 5 0 0 


95 
79 


23 6 9 61 0 0 
19 16 62_ 3 0 0 


.38 
.26 


.31 
.41 


Control 


14-A 
9-B 


80 
89 


14 11 13 63 0 0 
20 17 56 6 1 0 


89 
80 


10 7 10 71 0 0 
18 16 65^ 1 0 0 


.44 
.36 


.54 
.53 
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Table 133. Pretest to Posttest Changes 
(The response choice for 14-A is cited first.] 



Item Pair 14-A, 9-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D C D+C 


A* D* A+D 


B A B+A 


C B C+B 


Experi- 
mental 

Control 


-10 +7 -2 
+8 +9 +8 


+ 17 -2 +8 
-4 -5 -4 


0 -2 -2 
-4 -2 -4 


-7 -3 -6 
-3 -1 -2 



*A and D are not parallel distractors. 

Item pair 21-A/ 25-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest for the experimental 
group was 20 percent (from 49 to 69 percent) . Mean total gain for the 
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WHICH HODEL SHOWS HOW YOUR BODY GETS RID OF URINE? 21* WHICH MODEl SHOWS HOW YOUR BODY TAKES IN AIR? 25i 



Hark an X on your choice. 




C 0 



control group was six percent (from 42 to 48 percent), enabling us to 
attribute experimental group gains to the effect of instruction. 
Success on this pair of items should be even greater when the materials 
are used with the functioning human torso that was not available for 
the test trials covered in this report • Biserial correlations for the 
experimental group indicate that both items are good discriminators. 



Table 134. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


21- A 
25-B 


79 
95 


5 20 66 8 1 0 
9 6 35^ 49 0 0 


95 
79 


3 26 68 2 0 0 
5 14 71 9 1 0 


• 49 
.46 


.31 
.40 


Control 


21-A 
25-B 


80 
89 


15 30 5£ 5 0 0 
10 11 36 42 1 0 


89 
80 


4 29 47 17 1 1 

5 8 42 39 0 0 


.23 
.39 


.04 
.31 



Table 135. Pretes'u to Posttest Changes 
(The response choice for 21-A is cited first.) 



Item Pair 


21-A, 25-B 


Percent 


Change, Pretest 


to Posttest 




Student 
Group 


Correct 
Choice 






Parallel 


Distractor Pairs 




c c c+c 


A 


D 


A+D 


B 


A 


B+A 


D B 


D+B 


Experi- 
mental 


+2 +36 +20 


-2 


-40 


-21 


+6 


-4 


+2 


-6 +8 


+1 


Control 


-3 +13 +6 


-11 


-3 


-8 


-1 


-5 


-3 


+12 -3 


+5 
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Item pair 29-B functions at the cognitive level of knowledge. 

Mean total gain from pretest to posttest for the experimental group was 
seven percent (from 34 to 41 percent). Although gains were made, the 
relatively low achievement level confirmed teacher reports that students 
were having problems understanding the slides used in these activities. 
Artwork has been improved and simplified and the activity has been 
strengthened, all of which should improve student performance. Mean 
total gain for the control group was four percent. Biserial correlations 
indicate that the experimental group taking pretest A and posttest B 
performed much better on this item pair than did the pretest B-posttest 
A group, which confirms reports received from the teachers. 



Table 136. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


25-A 
29-B 


79 
95 


18 29 35^ 15 3 0 
16 34 39 12 0 0 


95 
79 


11 43 39 7 0 0 
13 44 28 14 1 0 


.16 
.01 


-.01 
.22 


Control 


2 5- A 
29-B 


80 
89 


24 25 29^ 23 0 0 
26 22^ 27 21 2 1 


89 
80 


9 16 34 39 1 1 
21 22 29 28 0 0 


.01 
.15 


.37 
.30 
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Table 137. Pretest to Posttest Changes 
(The response choice for 25-A is cited first.) 



Item Pair 25-A, 29-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C A C+B 


A D A+D 


B C B+C 


D A D+A 


Experi- 
mental 

Control 


+4 +10 +7 
+5 +1 +4 


-7 +2 --3 
-15 47 -4 


+14 -9 +2 
-9 +2 -4 


-8 -3 -6 
+16 -5 +5 



WHAi IS REMOVED fm THE BLOOD AT THIS POINT 
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Item pair 29-A, 20-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest or the experimental 
group was 27 percent (from 15 to 42 percent) which can be accounted for 
by losses from all dis tractors except carbon dioxide, which had a mean 
total gain of five percent (from 18 to 23 percent). Total gains for the 
experimental group were excellent, but it is evident that some confusion 
still exists between the functions of the lung and kidney. We feel 
strongly that the improved slides, functioning torso and films that 
will be avaiJcible with the commercial materials will alleviate this 
problem. The mean net loss of one percent (frrT. 15 to 14 percent) for 
the control group indicates an important gain is attributable to the 
'Effect of instruction in the experimental group. Biserial correlations 
were exceptionally good for the experimental group. 



Table 138. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 

# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


29-A 
20-B 


79 
95 


24 47 16 3 0 
2£ 13 33 33 2 0 


95 
79 


32 23 25 15 0 0 
4£ 23 20 6 3 0 


.40 
• 52 


.71 
.40 


Control 


29-A 
20-B 


80 
89 


6 23 33 33 6 0 
24 22 33 18 3 0 


89 
80 


12 25 25 34 2 1 
15, 15 36 29 4 0 


.25 
.24 


.35 
.20 



Table 139. Pretest to Posttest Chanc-s 
(The response choice for 29-A is citea first.) 



Item Paj 


ir 29-A, 20-B Percent Chanqe, Pretest to Posttest 


Student 
Grout 


Correct 
Choice 


Parallel Distractor Pairs 


A A A+A 


B B B+B 


c c c+c 


D D D+D 


Experi- 
mental 

Control 


+27 +28 +27 
+ 7 -9 -1 


-1 +10 +5 
+2 -7 -2 


-22 -13 -17 
-8 -rS -2 


"1 -2 7 -15 
+1 +11 +7 



Objective 203. Students will recognize , recall and be able to 
synthesize concepts presented in this unit . One student activity and 
other instructional strategists were designed to develop student com- 
petencies to achieve this objective. 

For activity 16, 94 percent of the teachers reported that they 
used the strategies as prescribed; six percent reported some modifica- 
tion. Ninety-four percent reported that the strategic- were successful. 
Some minor problems of reception were encountered with the colors used 
in the slides, but modifications should eliminate this problem entirely. 



156 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



Percent of 63 
teachers 50 - 
(N=16) 



63 I 

1 1 L ImMl 
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Figure 78. Reaction of the majority of students 
to activity 16 
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Figure 79. Importance to students of activity 16 
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Figure 80. Proportion of 
students able to perform 
on svibobjectives for 
activity 16 
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Figure 81. 
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Figure 78 shows that student reactions were quite high across the 
three rating scales. Figure 79 shows that teachers considered the 
activity to be important, and Figure 80 shows that 69 percent of the 
teachers reported that three-fourths or more of their students could 
successfully perform the behaviors prescribed in the subob jectives of 



157 



objective 203. Eighty-nine percent reported that one-half or more of 
their students were successful. Figure 81 shows that teachers con- 
sidered the oubobjectives to be very important. 

Three item pairs v;erG designed to assess student achievement on 
objective 203. 

HHAT CARRIES ALL OF THE FOLLOWING- OXYG[N. 10* "^^^ Cm\i% ALL OF THE FOLLOWING. OXYGEN.. IOb 

CARBON DIOXIDE, WASTE HATER. FOOD^ CARBON DIOXIDE, WASTE WATER. FOOD'' 

1aR»> an X ON YOUR CHOICE. 

Mask an X on vqur choice. ' " " ' " | ? 

, , ^ , ^ ^pj^^ ESOPHAGUS ■ ; HINDPIPE ' BLOOD ' 

tSOPHAGUS i WirjCPIPE ! URINE BLOOD ; ' ^ ' ' ' t ^ — i 

Item pair 10-A, 10-B functions at the cognitive level of knowledge. 
Mean total gain from pretest to posttest for the experimental group 
was 25 percent (from 47 to 72 percent) . This gain can be accounted for 
by losses from all other response choices. Mean total gain for the 
control group was 12 percent (from 34 to 46 percent) . These results 
clearly indicate that the experimental group gains can be attributed 
to the effect of instruction. Biserial correlations for both the 
experimental and control groups are excellent. It is evident from 
this item that approximately three- fourths of the students understand 
the distributive function of the blood. 



Table 140. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


10-A 
10-B 


79 
95 


20 15 24 39 1 0 
12 17 17 S5 0 0 


95 
79 


8 14 11 67 0 0 
3 8 11 2§. 0 0 


.06 
.19 


.54 
.65 


Control 


10-A 
10-B 


80 
89 


28 28 13 33 0 0 
10 19 37 34 0 0 


89 
80 


16 19 16 47 1 1 
6 23 25 45 1 0 


.21 
.21 


.54 
.35 



ERIC 
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Table 141, Pretest to Posttest Changes 
(The response choice for 10-A is cited first.) 



Item Pair 10-A, 10-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D D D+D 


A B A+B 


B C B+C 


C A C+A 


Experi- 
mental 

Control 


+28 +23 +25 
+14 +11 +12 


-12 -9 -10 
-12 +4 -4 


-1 -6 -3 
-9 -12 -11 


-13 -9 -11 
+ 3 -4 0 



WHICH OF m CANLirS HOdS 00 OUT FlPST''. 2:a ^Tju): WILL L\i riPST'> 

"ask an X ON THE PICTURE. A, > N T^^J. f* Tu^'t . 




c j ^ f ^ 



Item pair 20-A, 21-B functions at the cognitive level of analysis. 
Mean total gain from pretest to posttest for the experimental group 
was 22 percent (from 37 to 59 percent). These gains can be accounted 
for by losses on all other response choices, except response choice D, 
where gains were made on Form B. Mean total gain for the control group 
was 17 percent (from 30 to 47 percent). Student achievement on this 
item is outstanding considering the complex cognitive processes involved. 
The gain from pretest to posttest can clearly be attributed to the 
effect of instruction. Biserial correlations for the posttests for 
both experimental and control groups were very high. 
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Table 142. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Post test 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


20- A 

21- B 


79 
95 


27 1 41 32 0 0 
22 22 32 23 0 0 


95 
79 


1 4 68 26 0 0 
5 3 49_ 43 0 0 


.32 
.52 


.43 
.49 


Control 


20- A 

21- B 


80 
89 


31 9 21 20 1 0 
38 15 Zl 26 0 0 


89 
80 


16 8 48 28 0 1 
24 11 45_ 20 0 0 


.26 
.26 


.51 
.49 



Table 143. Pretest to Posttest Changes 
(The response choice for 20-A is cited first.) 



Item Pair 20-A, 21-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C C C+C 


A A A+A 


B B B+B 


D D D+D 


Experi- 
mental 

Control 


+27 +16 +22 
+9 +24 +17 


-26 -17 -21 
-15 -14 -15 


+3 -19 -8 
-1 -4 -3 


-6 +20 +7 
+8 J +1 



WHICH Of M FOLLOMNG A'^; mq-j' [^jirr thI hmD'> 2/a ^''iC" Of T^-P FCLLOi^ir/j ACT: *'0''T LP[ Ui -^LOOL'' Jfi? 




Item pair 27-A, 16-B functions at the cognitive level of compre- 
hension. Mean total gain from pretest to posttest for the experimental 
group was 16 percent (from 62 to 78 percent) . The gains can be accounted 
for by losses on all other response choices. Mean total gain for the 
control group was eight percent (from 59 to 67 percent), enabling v 
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to attribute the experimental group gains to the effect of instruction. 
This item pair and the previous two item pairs were designed to assess 
student achievement on summary items, and experimental group achievement 
here is encouraging, especially in view of the cognitive processes in- 
volved. Biserial correlations for both pretests and posttests indicate 
that this item pair is discriminating between high and low scoring 
students. 



Table 144. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


2 7- A 
16- B 


79 
95 


51 35 13 0 1 0 
73 14 0 14 0 0 


95 
79 


63_ 24 6 0 0 0 
87 8 0 5 0 0 


.27 
.54 


.60 
.65 


Control 


27-A 
16-B 


80 
89 


43 43 11 4 0 0 
74 15 1 7 3 0 


89 
80 


64 20 13 1 0 1 
71 11 1 16 0 0 


.22 
.59 


.37 
.40 



Table 145. Pretest to Posttest Changes 
(The response choice for 27-A is cited first.) 



Item Pair 27-A, 16-B 


Percent Charige* Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A A A+A 


B B B+B 


c c r+c 


D P 


D+D 


Experi- 
mental 


+18 +14 +16 


-11 -6 -8 


-7 0 -3 


0 -9 


-5 


Control 


+21 -3 +12 


"23 -4 -13 


+2 0 +1 


-3 +9 


+2 
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Objective Achievement Tests 

Descriptive Data and Interpretation ^ Pretests were administered 
to experimental classes between January 5 and March 2, 1971 and to con- 
trol classes between January 7 and 19, 1971. As was the case with Unit 
1/ differences in the cimount of time devoted to science instiruction 
caused a wide difference in posttest administration dates within the 
experimental group. The earliest was February 1, 1971 and the latest 
was March 31, 1971. Control group posttests were administered between 
February 10 and March 15, 1971. 

Raw score frequency distributions on the tests for both experimen- 
tal and control groups are shown in Table 146. Tables 147 and 148 
provide more detailed descriptive data on pretest and posttest scores 
and on residual gain scores, calculated with the raw regression coeffi- 
cient for the combined experimental and control classes. The interpre- 
tations that follow are based upon the data provided in these tables. 

1. Experimental classes using pretest Form A had similar pretest means, 
within the standard error of measurement. Experimental classes 
using pretest Form B registered means outside the range of the 
standard error of measurement, indicating different levels of 
student knowledge prior to instruction in Unit II. This result 
indicates that covariance analysis with pretest and posttest scores 
and/or analysis of variance using residual gain scores will be 
necessary for any comparisons of student achievement among experi- 
mental classes. 

2. Posttest means for Forms A and B were also outside of the standard 
error of measurement, but posttest reliabilities were above the 
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Table 146. Frequency Distribution of Raw Scores for 
Test Forms A and Experimental and Control Groups 



Experimental Groups 




Control 


Groups 


Raw 
Scores 


Pre 
A 


Post 
B 


Pre 
B 


Post 
A 


Pre 
A 


Post 
B 


Pre 
B 


Post 
A 




























1 














A 
*± 




4 














c\ 

y 


1 


9 




2 




2 




1 


1 A 

14 


4 


7 




4 




4 


20-21 


1 


12 


2 


8 


1 


9 


3 


2 


18-19 


7 


10 


5 


13 


5 


5 


4 


10 


16-17 


15 


6 


9 


26 


17 


13 


12 


11 


14-15 


19 


12 


20 


11 


16 


11 


24 


15 


12-13 


14 


6 


23 


10 


19 


17 


21 


30 


10-11 


15 


3 


14 


5 


14 


7 


13 


6 


8-9 


5 


1 


15 




6 


10 


6 


6 


6-7 


1 


2 


2 


1 


2 


2 


4 


1 


4-5 














2 




2-3 


1 














1 


0-1 
















1 


Totals 


79 


79 


95 


95 


80 


80 


89 


89 



minimum acceptable level of ,70. Fifteen of 16 experimental classes 
showed positive mean residual gain scores and the one negative score 
was not seriously low. A multiple stepwise regression was performed 
to determine the effects of the independent variables on posttest 
scores. Analysis of variance on residual gain scores was also per- 
formed to confirm the results of the covariance analysis. 
3. Means for control classes using pretest Form B were within the 

limits of the standard error of measurement but those using pretest 
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Form A were not, indicating different levels of knowledge at the 
time of pretesting. 
4. Posttest means for control classes were outside the limits of the 
standard error of measurement for both Form A and Form B. This 
result together with positive mean residual gain scores for classes 
91 and 93 and the high gains on seme test items, indicate that 
instruction probably took place in these classes between pretesting 
and posttesting. This eliminates the possibility of using control 
classes to compute a test-retest reliability for Unit II. An exam- 
ination of the control group test score frequence distribution (see 
Table 146) , also indicates small upward shifts. 

Multiple stepwise Regression Analysis 

Experimental Group , Unit II . To determine the effect of the inde- 
pendent variables on posttest . -ores, the following question was investi- 
gated: "Is there a significant difference in the level of achievement 
on the posttest among students in EMH classes having different background 
variables?" 

The following independent variables were used to test this question: 
sex, age, WISC Full Scale IQ, race, teacher's assessment of reading 
achievement, teacher's assessment of verbal oarticipation, and pretest 
score. All scores from Form A and Form B were pooled and treated as the 
results from one test. 

The results for the posttest administered to the 174 students in the 
Unit II experimental group are summarized in Table 149. 

The F-value for each independent variable detemines the level at 
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which that variable is a significant predictor of a score on the posttest 
instrument. 



Table 149^ Results of Multiple Linear Regression Analysis , 
Experimental Group, Unit II 



Independent Variable 




S3, 


F 


Sex 


-1.4771 


.5819 


6.4424** 


Age 


0.0169 


.0152 


1.2352 


Wise Total IQ 


0.0940 


.0242 


15.063?*** 


Race 


-0.4357 


.4137 


1.1087 


Reading Achievement 


0.4977 


.2310 


4.6397* 


Verbal Participation 


-0.3070 


.2514 


1.4913 


Pretest 


0.5622 


.0848 


43.9080*** 



*Significant at .05 level, F = 3.84 

. Ub (1 ^ loo; 

**Signif icant at .025 level, F = 5.02 

.025(1,166) 

***Signif icant at .001 level, F ,,,, = 10.83 

.001 (1,166) 



Discussion 

The data indicate that age, race and teacher's assessment of verbal 
participation are not significant predictors of success on the posttest. 
Wise Total IQ and the pretest score, however, are highly significant pre- 
dictors of success on the posttest (P<.001). Sex is also a significant 
predictor (P<.025), as is the teacher's assessment of reading ability 
(P<.05). Thfese results are essentially equivalent to those of 
Unit I ~ that is WISC IQ and prior knowledge of the subject matter, 
as measured by the pretest score, are the best determinants of the 
level of success on the posttest instrument. It is logical to assume 
that a student with a high score on a pretest instrument will likewise 
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achieve a high score on a parallel form of the same instrument adminis- 
tered as a post test after instruction • An analysis of variance on 
residual gain scores was computed to determine the exact relationship 
between sex, reading level, IQ and success on the posttest. 

The effect of the pretest accounts for approximately 35.8 percent 
of the variance in the regression equation. This is not as high as the 
44.2 percent accounted for in the Unit I testing but is still satisfactory. 
The combination of pretest and WISC Total IQ account for 41.4 percent of 
the variance in Unit ll, while the same two variables accounted for 48.8 

Table 150. Matrix of Correlation Coefficients 
Experimental Group, Unit II 



Age 


Total 
IQ 


Race 


Reading 
Achieve- 
ment 


Verbal 
Partici- 
pation 


Pre- 
test 


Post- 
test 


Sex -.093 


-.128 


-.090 


.081 


-.021 


-.202 


-.261 


Age 


-.085 


-.259 


.166 


.023 


.317 


.246 


Total 
IQ 




-.018 


.207 


.205 


.281 


.394 


Race 






-.088 


-.185 


-.029 


-.084 


Reading 
Achieve- 
ment 








.387 


-331 


.315 


Verbal 
Partici- 
pation 










.237 


.149 


Pretest 












.599 



percent in Unit I. The inclusion of all seven independent variables 



accounts for 45.8 percent of the variance in the regression equation, as 
contrasted with the 53.5 percent accounted for in Unit I. Both levels 
are entirely satisfactory, but the question of what accounts for the 
remaining variance in both units seems puzzling. A likely hypothesis 
^ is that the teacher effect plays an extremely important role. 

ERIC 
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Table 15a. Multiple Stepwise Regression Analysis 
Experimental Group, Unit II 



Step 
Num- 
ber 


Variable 
Entered 


Multiple 

2 

r r 


Increase 
2 

in r 


F"Value 
to Remove 


No, of 
Independent 
Variables 


1 


Pretest 


.5986 


.3583 


.3583 


96.0454 


1 


2 


Total IQ 


.6432 


.4137 


.0554 


16.1633 


2 


3 


Sex 


.6554 


.4295 


.0158 


4.6936 


3 


4 


Reading 
Achievement 


.6659 


.4434 


.0139 


4.2237 


4 


5 


Age 


.6717 


.4512 


.0078 


2.3925 


5 


6 


Verbal 
Partici- 
pation 


.6743 


.4547 


,0035 


1.0734 


6 


7 


Race 


.6770 


.4583 


.0036 


1.1087 


7 



Analysis of Variance and Covariance 
Experimental Group 

Two different statistical analyses were performed to investigate 
the question, "Is there a significant difference between experimental 
classes in the level of achie^-ement on the Unit II posttest?" The 
results of an analysis of covariance are summarized in Table 152. 

Table 152. Analysis of Covariance Between Classes 
'^n Adjusted Unit II Posttest Means, Pretest as CovaridCe 



Source d.f. Mean Square F-Ratio 

Between Groupj lb 34.9766 3.0206** 

Within Groups 164 11.5794 

**Signif icant at .00] level, F , « 2.51 

' .001(15,157) '^-^ 



These results indicate that significant differences do exist between 
experimental classes on posttest means adjusted for differences in 
pretest scores. 

Table 153 summarizes the means and standard devict ons for pretests 
and post tests for each class in the experimental group. 



Table 153, Means , Standard Deviations, and Adjuste d Means of 
16 Classes Experimental Group, Unit II 



Class 
IN umoer 


M 


Posttest 
Mean 


Posttest 
Standard 
Deviations 


Adjusted 
Posttest 
Mean 


Pretest 
Mean 


91 


c 
D 


15.20 


7.66 


16.55 


13.00 


22 


10 


18.80 


5.59 


19.01 


13.20 


23 


12 


18.25 


3.82 


17.46 


14. 5h 


24 


11 


14.64 


3.70 


15.19 


12.' 3 


25 


10 


21.00 


4.16 


20.56 


14.10 


26 


13 


22.15 


2.19 


21.90 


13.85 


27 


10 


17.30 


4.19 


17.29 


13.50 


28 


8 


19.63 


4.24 


18.53 


15.00 


31 


9 


21.00 


4.69 


21.43 


12.89 


32 


12 


15.42 


3.87 


17.15 


11.08 


33 


11 


19.36 


4.37 


17.15 


16.55 


34 


13 


18.77 


4.09 


18.07 


14.46 


35 


11 


*^.00 


3.46 


18.13 


10.55 


36 


11 


20.09 


3.88 


18.54 


15.64 


37 


15 


16.07 


3.22 


16.81 


12.47 


38 


13 


16.85 


5.44 


17.42 


12.69 



An analysis of variance on residual gain scores was performed to 
confirm the results of the analysis of covariance. The residual gain 
score used in this analysis was computed using the within-class pooled 
regression coefficient of experimental class- s only. The results of 
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the analysis of variance, indicating a significant difference at the 
.001 level, are siammarized in Table 154. 

This is the same result obtained with the analysis of covariance, 
but is somewhat surprising since no differences were found between 
classes in Unit I. Table 155 summarizes the means and standard devia- 
tions for residual gain scores for each class in the experimental group. 



Table 154. 


Analysis of 


Variance Between Classes on 


Residual Gain 




Scores, 


Experimental Group, Unit II 




Sourc*" 


d.f . 


Mean Square 


F-Ratio 


Between Groups 


15 


35.1114 


3.0515** 


Within Groups 


158 


11.5061 





**Significance at the .001 level, F ^^,,,1, t^-ox = 2.51 



Discussion 

The significant differences between experimental classes were not 
entirely unexpected. Teachers deviated from recommended strategies 
much more in Unit II than in Unit I. Since there is surely a link 
between teacher performance cind student achievement in a program like 
ME NOW, we feel that teacher behavior and comportment are important 
factors in the significant differences. The importance of classroom 
observers during experimental trials should be emphasized in future 
trials o- similar materials. 

Factorial Analysis , Experimental Gi oup 



The results of the multiple linear regression on the posctest 
indicated that WISC Total IQ, sex and teacher's assessment of reading 
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achievement were significant predictors of success on the posttest 
To further investigate this result and to minimize the effect of the 
regression to the posttest mean, the following question was investi- 
gated: "Is there a significant difference in residual c,ain scores 
between students blocked on two levels of sex, three ranges of WISC 
Full Scale IQ scores, and three ranges of reading achievement?" 



For Unit II, factorial analyses were also performed using wiSC 



Verbal 


and 


Numerical IQ scores. Because these data are 


available for 


a reduced 


number of 


students. 


these analyses 


were not performed 


in the 


three- 


dimensional model used 


in the Unit II 


aridlysis. 


Only the 


results 






Table 155. 


Residual Gain, 


Class Data. 












Experimental Group, Unit II 






Class 






Standard 


Standard 








Number 


N 


Mean 


Deviation 


Error 


Maximum 


Minimum 




21 


5 


-1.65 


5.48 


2.45 


3.99 


-9.40 


13.39 


22 


10 


0.81 


4.00 


1.26 


7.43 


-6.23 


13.66 


23 


12 


-0.74 


3.23 


0.93 


2.26 


-5.29 


7.55 


24 


11 


-3.01 


4.07 


1.23 


3.32 


-8.01 


11.33 


25 


10 


2.36 


3.48 


1.10 


5.99 


-5.57 


11.56 


26 


13 


3.70 


3.14 


0.87 


8.60 


-0.46 


9.06 


27 


10 


-0.91 


2.40 


0.76 


4.04 


-3.57 


7.61 


28 


8 


0.33 


2.78 


0.98 


4.15 


-2.68 


6.83 


31 


9 


3.23 


3.21 


1.07 


7.15 


-3.23 


10.38 


32 


12 


-1.04 


3.40 


0.98 


5.43 


-7.29 


12.72 


33 


11 


-1.04 


2.46 


0.74 


2.99 


-4.8C 


7.79 


34 


13 


-0.13 


3.23 


0.90 


4.82 


-6.01 


10.83 


35 


11 


-0.07 


3.81 


1.15 


6.88 


-6.74 


13.62 


36 


11 


0.34 


2.82 


0.85 


4.37 


-5.74 


10.11 


37 


15 


-1.39 


2.44 


0.6? 


2.77 


-5.57 


8.34 


38 


13 


-0.78 


4.46 


1.24 


6.15 


-6.50 


12.65 
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of the analysis using WISC Full Scale IQ scores with 172 students are 
reported here. 

Residual gain scores for 172 students with WISC Full Scale IQ data 
were blocked in two different levels of sex: male and female; on three 
different levels of WISC IQ scores: 66 and less, 67 to 79, and 80 
and above; and on three levels of reading achievement: readiness and 
first grade, second grade, and combined third, fourth and fifth grades. 
An analysis of variance was performed on the residual gain scores in 
this 2x3x3 factorial design. Table 156 summarizes the results of the 
analysis of variance, indicating no significant differences betv^een 
reading groups, no significant interaction effects for any level of 
interaction, and significant differences between levels of sex and 
WISC Full Scale IQ. 



Table 156. ANOVA, Residual Gain Blocked on V^TSC Full Scale IQ. sex and 

Reading Level, Experimental Group, Unit II 



Source 




Hypothesis 




Significance 


d.f . 


Mean Square 


F 


Level 


Between sex Levels 


1 


75.9648 


6.2665 


P<.0134 


Between IQ *.evels 


2 


91.2407 


7.5267 


P<.000S 


Between Reading Levels 


2 


23.2840 


1.9208 


P<.1500 


Sex - IQ Interactions 


2 


8.1854 


.6752 


P<.5106 


Sex - Reading Interactii^n 


2 


22.0845 


1.8218 


P<.1652 


IQ - Reading Interaction 


3 


10.8181 


.8924 


P<.4466 


High Level Interaction 


4 


16.6317 


1.3720 


P<.2462 



Table 157 summarizes the means and standard deviations for each cell 
in the analysis. Table 158 summarizes the means for the combined cells 
vrtiich form the its of concern. 



173 



Table 157, Cell Means and Stcindard Deviations for Factorial Analysis ^ 

Blocked Data^ Unit II 



Cell Sex 

1 Male 

2 Male 

3 Male 

4 Male 

5 Male 

6 Male 

7 Male 

8 Male 

9 Male 

10 Female 

11 Female 

12 Female 

13 Female 

14 Female 

15 Female 

16 Female 

17 Female 

18 Female 



N 
14 



3 
20 
29 
23 

6 



Factor Levels 
Wise IQ Reading 

£66 Readiness 

First Grade 

36 Second Grade 



<66 Fourth, Fifth 

Sixth Grade 

67 - 79 Readiness - 

First Grade 

67 - 79 Second Grade 



67-79 Fourth, Fifth 

Sixth Grade 

^80 Readiness - 

First Grade 

>80 Second Grade 



>80 Fourth, Fifth 

Sixth Grade 

^6 Readiness - 

First Grade 

<6o Second Grade 



<66 Fourth, Fifth 

Sixth Grade 

67 - 79 Readiness - 

First Grade 

67 - 79 Second Grade 



67 - 79 Fourth, Fifth 

Sixth Grade 

^80 Readiness - 

First Grade 

>80 Second Grade 



^80 Fourth, Fifth 3 

Sixth Grade 



13 
6 
6 



11 
7 

16 
0 



Standard 
Mean Deviation 

•1.58 3.29 
•2.21 5.13 
1.06 2.92 



-0.61 
0.79 
0.63 
4.46 
1.89 
1.73 
-3.99 
-0.42 
-1.92 
-2.25 
1.62 
-0.41 



3.93 
4.35 
2.91 
1.84 
4.59 
2.77 
2.36 
4.50 
1.22 
2.68 
2.56 
3.12 



-0.93 5.35 
1.47 1.95 
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Table 158. Means for Combined Cells - Factorial Analysis 
Experimental Group ^ Unit II 



Factor Level „ 

Mean 



"^^^^ 0.46 
Females _q 

Wise I Q <66 , 

Wise I Q 67 - 79 3 32 

Wise I Q 80 and above 3^ g2 

Readiness - First Grade Reading -1.01 

Second Grade Reading q 

Fourth, Fifth, sixth Grade Reading 0.49 

Discussion 

The analyses of variance were computed in the 2x3x3 factorial 
design with residual gain scores blocked on sex; low, middle and high 
ranges of WISC Full Scale IQ; and three ranges of reading ability. The 
results indicate that there are no significant differences between 
reading levels when the residual gain score is the dependent variable. 
Reading achievement for Unit ll must be treated like age in Unit I - 
the multiple linear regression identified both as predictors of success 
on the posttest instrument, but there are no differences in posttest 
achievement between the reading levels used in this analysis. A regres- 
sion to the posttest mean could account for the results of the regression 
analysis. 

■mere was a significant difference in level of achievement between 
males and females in Unit ll (P<.0134). We can only conclude that males 
do better than females. Any speculation on why would be -ily that ~ 



speculation. 

. ■ ,»( , i,i,f 



Students in Unit ll with WISC Full Scale IQ scores between 67 and 
79 scored significantly higher than students with IQ scores of 80 and 
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above. Both of these groups scored significantly higher than students 
whose IQ score was 66 or less (P<,0008) . Since ME NOW was designed for 
students with an IQ of 65 to 80, these results indicate that the Unit II 
materials are suitable for the target population. The ME NOW materials 
are probably too difficult for students with WISC Full Scale IQ scores 
below 65. Why students with IQ scores of 80 and above did not achieve 
higher scores is unknown. Many such students in EMH classes are emo- 
tionally diisturbed and not mentally handicapped. The effect of mental 
disturbances on achievement in ME NOW has not been investigated. Sug- 
gestions for teachers should be included in the Teacher's Guide for 
students with IQ scores below 65. 

Experimental -Control Group Analyses 

To investigate the question, "Is there a significant difference in 
student achievement between the experimental and control groups?" 
residual gain scores v^ere com,>uted using the raw regression coefficient, 
obtained by pooling ail experimental and control students, and an 
analysis of variance was performed. Table 159 summarizes the mean 
residual gain scores and standard deviations for both groups. 



Table 159. Residual oain Means and Standard Deviations 
Experimental and Control Gr o ups, Unit II 



Group 



N 



Mean 



Standard 
Deviation 



Experimental 



^74 



1.7l 



3.68 



Control 



169 



1.79 



3.61 



176 

Table 160 summarizes the results of the analysis of variance, 
indicating a significant difference between experimental and control 
groups (P<.001). 



Table 160. MOVA, Experimental and Control 
Residual Gain Scores , Unit II 



Source 


d*f • 


Mean Square 


F-Ratio 


Between Groups 


1 


1083.4948 


81.5690** 


Within Groups 


341 


13.2832 




♦^Significant at 


.001 level. 


^,001(1,341) " ^^-^^ 





Discussion 

The results of the analysis of variance indicated that there was a 
significcuit difference between the experimental and control groups 
on residual gain scores (P<.001). On the basis of these results, we 
concluded that the experimental Unit II materials did have an effect 
on EMH students, as assessed by the objective tests. All 30 items on 
both forms assessed achievement on major objectives in Unit II, four 
were judged to measure baseline information, and 27 were considered to 
be good indicators of student growth from pretest to post test. 

f gcco^ Analysis 

To aetermine the structure of the Unit II achievement tests, a 
Harris-Kaiser oblique, unnormalized , orthogonal rotation was performed 
on the results of pc£»ttests A and B. For posttest A, 19 factors were 
identified which accounted for 48.3 percent of the variance. For 



177 



posttest B, 19 factors were identified which accounted for 51.5 percent 
of the variance. 

Table 161 presents the results for posttest A showing only those 
factors with eigenvalues above 1. The objective measured and cognitive 
level of each item is included, as is a hypothetical name for each 
factor. The cognitive levels identified are the same as for Unit I. 





Table 


161. Factor 


Structure - 


Unit II. Posttest 












Factor 


Items 


Cognitive 
Level 


Objective 


Name 


1 


9 


low 


200 


diaphragm identification 




22 


knowledge 


200 




2 


5 


low 


201 


exercis*^ - energy release 




14 


low 


202 


relationships 


3 


24 


low 


201 


respiratory - circulatory 




30 


high 


2C0 


relationships 


4 


13 


knowledge 


200 


respiratory - excretory 




29 


low 


202 


relationships 


5 


3 


high 


202 


oxygen - carbon dioxide 




28 


low 


201 


relationships 



Table 162 presents the results for posttest B showing only those 
factors with eigenvalues above 1. 

Although no pairs of factors from the two test forms were identical, 
seven item pairs appeared in the five factors reported here, items 
loading on the five factors with eigenvalues abov.- 1 in each test form 
were well distributed across the test and measured identical or closely 
related objectives. 
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Table 162. Factor Staructure - Unit II ^ Posttest B 



1? a 4- oy* 


Items 


Cognitive 
Level 


objective 


Name 


1 


9 


low 


202 


respiratory - energy 




15 


knowledge 


201 


relationships 




2» 


low 


202 




2 


6 


knowledge 


202 


organ recognition 




1 O 


knowledge 


200 




3 


25 


low. 


202 


circulatory - respiratory 




10 


knowledge 


203 


relationships 


4 


12 


low 


201 


exercise - breathing rate 
relationships 


5 


1 


high 


200 


respiratory - excretory 




7 


low 


200 


functions 




20 


low 


202 





Suninary 

We can safely conclude that the EMH students in our sample learned 
from the experimental Lnit ll materials. Pretest-to-posttest gains in 
item scorirb were generally excellent and item response pat rns helped 
identify and/or confirm problems with the experimental materials. 
Student enthuixasm was high and teacher feedback indicated that there 
were many applications and extensions to the activit.T^s. Experimental 
group achievement was superior to that of the control group, in spite 
of the fact that three control classes wera taught the sijbject matter 
covered by the tests because of student interest generated during test 
administration . 



CHAPTER IV 
EVALUATION OF UNIT III 
MOVEMENT , SUPPORT ^ AND SENSORY PERCEPTION 

The Instructional Program 

For the experimental classes, instruction with the experimental 
Unit III materials was -nitiated in the Spring of 1971. The first 
class began on February 3 and the last on April 1, 1971. The first 
class finished Unit ill on March 8 and the last class finished on 
May 5, 1971. The total class time devoted to instruction of Unit III 
ranged from 450 to 1,290 minutes, with a mean for the 16 classes of 
659 minutes (11 hours). 

The role of muscle, bones, brain, nerves and sensory receptors in 
ME NOW is the focus of Unit III. Students begin the unit by feeling 
their biceps relax and contract and then build a paper model of a 
muscle. The relationship bet;een muscles and bones is developed by 
attaching the muscle model to yardsticks; the students' conclusions are 
verified by dissecting a chicken wing and observing the muscles and bones. 
Muscle conditioning by exercise is investigated, followed by an investi- 
gation of the protective functions of bones and muscles. 

The concept of balance is introduced by using a ruler and paper 
clips, after which inquiries are conducted using each of the senses 
separately. A field trip through the school with blindfolds in place 
helps students utilize senses other than sight in determining their 
location within the building. The interaction of senses ar.d student 
reaction to sensory stimuli is investigated. A review of the role of 
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the senses is conducted by iising the film, Me and My Senses . The co- 
ordinating role of the brain is investigated through the use of a puppet 
and slides, as is the role of the nerves • The role of the brain in learn- 
ing is investigated by using slides and a maze, and the different percep- 
tions of objects by different people is investigated by the use of inkblots, 
slides and worksheets. An attempt to influence student attitude in a 
positive manner is made in the last activity through th^ use of the film, 
Garbage , and student-teacher dialogue. 

Objective 300 . Students will associate bones and muscles with body 
movement, si:g)port and balance , six student activities and other instruc- 
tional strategies were designed to develop student competencies to 
achieve this objective. 

For activities 1 to 3, 75 percent of the teachers reported using 
the strategies as prescribed; 25 percent reported some modification. 
Ninety-four percent reported the strategies successful. One teacher 
reported that her students encountered difficulties in folding the paper 
to construct the muscle model. Another teacher reported, "After children 
made the bone-muscle model, which they did much faster and with much 
more accuracy than I thought they would, we taped a foot on it and it 
became a leg, next we taped a head on it and it became a neck. This, 
I think, reinforced the idea of muscle-bone relation." 

Another teacher reported, "Since we adults had trouble with this 
activity I knew my class would not be able to work with the chicken wing. 
So, we all sat around a table and I worked with the wing while they 
watched. Twice I passed the wing around so they could see what I was 
doing. " 
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In contrast to the above stateirent, another teacher wrote, "The 
dissecting of the chicken wings was out of sight. All the kids were 
really motivated and excited. I let each child have his own wing within 
the grouped situation. This added to the motivation and learning desired. 
I got two chicken feet from the market and we found the tendons in the 
'skin' part — by pulling tendons, we weie able to make the chicken claws 
'curl up' and straighten when the tendons were released. This delighted 
the kids and of course they all got into the act." 

Another teacher remarked, "I have regular fourth and sixth graders 
participate in our science program. My boys have a considerably better 
understanding of arm structure than either of these groups." 

It is evident that where prescribed strategies were followed, 
student enthusiasm was high and they were able to perform the tasks in 
'he activities. However, as the literature states repeatedly, where a 
teacher's expectation is very low, student success will also be very 
low. 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



Percent of 63 
teachers 50 
(N=16) 




543215432154 



2 1 



5 = high 
3 = neutral 
1 = low 



Figure 82. Reaction of the majority of students 
to activities 1 to 3 

Figure 82 shows that teachers found student reactions to be very 

high across the three rating scales. All activities were judged to be 

important, hut activity 3 was rated more important than 1 or 2. The 

average rating for the three activities is found in Figure 83. 
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100 



Percent 50 




I 



Percent of 
teachers 
{N=14) 



5 4 3 2 1 
Important OK * Useless 

Figure 83. Importance to students of activities 1 to 3 
Figure 84 shows the proportion of students who were able to per- 
form the behaviors specified by the seven subob jectives. Eighty-seven 
percent of the teachers reported that three- fourths or more of their 
students could perform the prescribed behaviors. Teachers considered 
the subobjectives for thip objective to be inportant (see Figure 85). 
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100 



50 - 



Percent of 
teachers 
(N=16) 




All 1 1 i /I None 
4 2 4 4 



Figure 84. Proportion of 
students able to perform 
on subobjectives of 
objective 300 



5 4 3 2 1 

Important < OK * Useless 

Figure 85. Importance of the 
subobjectives 



For activities 4 to 6, 63 percent of the teachers reported using 
the strategies as described; 37 percent reported some modification. 
All teachers reported the strategies successful. One very useful modi- 
fication was suggested by a teacher: "Instead of giving everyone a 
box to work v;ith for the balancing, for my group I felt it wiser to 
present the task as a challenge to individuals. Different people, 
ultimately everyone, volunteered to demonstrate the fete. The focus of 
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attention was much more intent on the idea and what it meant than if I 
had asked everyone to do it at the same time." 

Figure 86 shows that teachers found student reactions to be high 
across the three rating scales. Activity 6 was considered to be more 
important than activity 5, and activity 4 was considered to be least 
iirportant of the three. The average ratinys for the three activities 

are shown in Figure 87. 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 



Percent of 
teachers 
(N=16) 



63 63 63 



543215432154321 

Figure 86. Reaction of the majority of students 
to activities 4 to 6 




5 = high 
3 = neutral 
1 = low 
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Figure 87. Importance to students of activities 4 to 6 
Figure 88 sho\^?s the proportion of students who were able to per- 
form the behaviors specified by the seven subobjectives. Sixty-five 
percent of the teachers reported that three-fourths or more of their 
students were successful. Teachers considered the subobjectives to be 
important (see Figure 89), 
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Figure 88. Proportion of Figure 89, Importance of the 

students able to perform subobjectives 
on subobjectives of 
objective 300 



Eight item pairs were designed to sample achievement on this 
objective . 



2a 3b 

WHICH PERSON IS Doing the best TIiII^G to flAKF HIS MUSCLES Smm'> WHICH PERSON IS DOING THE BEST THING TO MAKE HER WSCLES STROfiGER'> 




Item pair 3-B functions at the cognitive level of comprehen- 

sion. Mean total gain from pretest to posttest Tor the experimental group 
was nine percent (from 71 to 80 percent). However, the achievement level 
on Form B was much lower than on Form A. This suggests that students are 
having difficulty identifying dancing as an exercise more strenuous than 
walking. Consequently, the dancing girl was replaced by a swimmer. 
There was a mean net loss of four percent from pretest to posttest for 
the control group. Therefore experimental group gains can be attributed 
to the effect of instruction, Biserial correlation levels indicate that 
O „ both items are good discriminators. 
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Table 163. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of u 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


2-A 
3"B 


78 
85 


0 0 95 5 0 0 
47^ 2 0 51 0 0 


85 
78 


0 1 94 5 0 0 
€r5 1 1 32 0 0 


.55 
.23 


.40 
.36 


Control 


2-A 
3"B 


84 
82 


0 2 94 4 0 0 
52 1 6 40 0 0 


82 
84 


0 2 91 6 0 0 
48 4 0 48 0 1 


.39 
.17 


.54 
.42 



Table 164. Pretest to Posttest Changes 
(The response choice for 2-A is cited first.) 



Item Pai 


.r 2-A, 3-B Percent Change, Pretest to Posctest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C A C+A 


A C A+C 


B B B+B 


D D D+D 


Experi- 
mental 

Control 


-1 +18 +9 
-3 -4 -4 


0+10 
0 -6 -3 


+ 1 -1 0 
0 +3 +1 


0 -19 -10 
+2 +8 +3 



WWT W TtC S'iCKS i'i T^€ m OF THE AJr STflfC enp VOf, W , 3a 
SKIl JG1»T> 








BONE 




SKIN 




JOINT 



BOfif 



SKiN 



__q 

JOINT 



Item pair 3-A, 11-B functions at the cognitive level of comprehen- 
.sion. Mean net gain from pretext to posttest for the experimental group 
was 16 percent (from 53 to 69 percent) . Since achievement on Form B is 
higher than on Form A, it appears that students are more familiar with 
mtiscle than with bone, it was suggested that more emphasis be placed on 
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the role of bones in the revised materials. Mean net gain for the control 
group was one percent (from 45 to 46 percent). This result enableo us 
to attribute experimental group gains to the effect of instruction, Bi- 
serial correlations for the experimental group ar-e very high. 



Table 165. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


Ix-B 


78 

85 


53 32 6 9 0 0 
72 9 4 14 0 0 


85 
78 


27 51 5 18 0 0 
88 1 3 8 0 0 


.50 
.61 


.53 
.63 


Control 


3-A 
11-B 


84 

82 


52 24 8 15 0 0 
66 6 6 17 4 1 


82 
84 


55 18 6 18 1 1 
74 7 5 14 0 0 


.33 
.50 


-.10 
.70 



Table 166. Pretest to Posttest Changes 
(The response choice for 3-A is cited first.) 



Item Pair 3-A, 11-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Dis tractor 


Pairs 




B A B+A 


A B 


A+B 


c 


C C+C 


D D 


D+D 


Experi- 
mental 


+19 +15 +16 


-26 -8 


-17 


-1 


-1 -1 


+9 -6 


+ 1 


Control 


-6 +8 +1 


+3 +1 


+2 


-2 


-1 -2 


+3 -3 


0 


WHlfH \S )01NT'> 

f1*P* m f, ]H M. UKLt y* TX LJNt THAT T00O*S TK JCJVT 


u 




















' ^^^-^^^Sl::^ 






A 

















Item pair 6-A, 2-B functions at the cognitive level of knowledge 
Mean total gain from pretest to posttest for the experimental group was 
16 percent (from 59 to 75 percent) . Mean gain for the control group was 
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Table 167, Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Post test 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 




78 
85 


13 26 50 12 0 0 
4 13 68^ 15 0 0 


85 
78 


6 9 68 16 0 0 
0 6 82 12 0 0 


.65 
.71 


.71 
.63 


Control 


6-A 
2-B 


84 
82 


11 17 57 15 0 0 
5 17 61 16 0 1 


82 
84 


11 18 57 12 0 1 
6 11 70 13 0 0 


.47 
.59 


.67 
.67 



Table 168. Pretest to Posttest Changes 
(The response choice for 6-A is cited first.) 



Item Pair 6-A, 2-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


C C C+C 


A A A+A 


B B B+Jb 


D D D-rD 


Experi- 
mental 

Control 


+18 +14 +16 
0 +9 +5 


-7 -4 -5 
0+10 


-17 -7 -11 
+1 -6 -3 


+4 -3 0 
"3 -3 "2 



five percent (from 59 to 64 percent) , thus the experimental group gains 
can be attributed to the effect of instruction. It appears that EMH 
students in our f^anple recognized the ankle as a joint with more facil- 
ity than the wrist; the reason why has not been investigated. Biserial 
correlations are excellent for both experimental and control groups. 



THESE ARE OMWINCS OF DIFFEPENT flUSCLES. 
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Item pair 11-A/ 14-B functions at the cognitive level of analysis 
and provides baseline information concerning students* knowledge of the 
manner in which muscles work. Although no gains were achieved by the 
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Table 169. Item Responses and Biserial Correlations 
for E:q)eriinental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


11-A 
14-B 


78 
85 


90 3 1 3 0 4 
1 90 2 4 2 1 


85 
78 


92^ 6 0 0 1 0 
1 87 1 1 3 6 


.74 
.63 


.75 
.68 


Control 


11-A 
14-B 


B4 
B2 


93 1 2 1 0 2 
3 80 4 2 1 8 


82 
84 


90 0 1 0 6 2 
5 88 0 1 2 4 


.60 
.72 


.22 
.64 



Table 170. Pretest to Posttest Changes 
(Tne response choice for 11-A is cited first.) 



Item Pa 


ir 11-A, 14-B Percent Chanqe Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


A B A+B 


B A B+A 


C C C+C 


D D D+D 


Experi- 
mental 

Control 


+2 -3 0 
-3 +8 +2 


+ 3 0 +2 
-1 +2 +1 


-1 -1 -2 
-1 -4 -3 


-3 -3 -4 
-1 -1 0 



experimental group, an achievement level of 90 percent is entirely 
satisfactory. The control group gained two percent from pretest to 
posttest (from 87 to 89 percent) . It is evident that the students are 
already familiar with the concept of muscle contraction, but the ME NOff 
Unit III materials are designed to start at this point and build up a 
knowledge of the relationships between the muscular system and the other 
systems of thfe body. Biserial correlations are exceptionally high for 
the experimental group and for all but posttest Form A of the control 
group . 



Item pair 13-A, 23-B functions at the cognitive level of comprehen- 
sion and provides baseline information on students 's knowledge of a 
concept of balance. Mean total gain from pretest to posttest for the 
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esqperiroental group was seven percent (from 78 to 85 percent). Mean 
total gain for the control group was ten percent (from 78 to 88 percent). 
Because of the control group gains, no effect can be attributed to in- 
struction, but the gains can be accounted for by losses on all other 
response choices. Biserial correlations indicate that the items discrim- 
inated well between high- and low-scoring students, except in the case 
of posttest Form B in the experimental group. 

Table 171. Item Responses and Biserial Correlations 
for Es^primental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


13-A 
23-B 


78 
85 


4 78 13 4 1 0 

5 13 78 4 1 0 


85 
78 


2 87 7 4 0 0 
1 12 63 3 1 0 


.31 
.28 


.59 
.09 


Control 


13-A 
23-B 


84 
82 


4 81 14 1 0 0 
6 13 74 5 0 1 


82 
84 


0 90 9 0 0 1 
2 12 86 0 0 0 


.34 
.33 


• 34 
.42 
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Table 172. Pretest to Posttest Changes 
(The response choice for 13-A is cited first.) 



Item Pair 13-A, 23-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 




B C B+C 


A D A+D 


D 


A D+A 


C B 


C+B 


Experi- 
mental 


+9 +5 +7 


-2 -1 -2 


0 


-4 -2 


-6 -1 


-4 


Control 


+9 +12 ^+10 


-4 -5 -4 


-1 


-4 -2 


^5 .1 


-3 
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Item pair 20-A, 16-B f motions at the cognitive level of analysis. 

Mean total gain from pretest to posttest for the experimental group was 

16 percent (from 51 to 67 percent), with the exception of the response 

choice "skin and bones" all other distractors dropped fxon pretest to 

posttest. Mean total gain for the control group was ten percent (from 

50 to 60 percent). Based on these results, we can attribute experimental 

group gains to the effect of instruction. The revised materials should 

Table 173. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


20-A 
16-B 


78 
85 


9 12 32 47 0 0 
5 9 54 29 1 1 


85 
78 


13 6 19 61 0 1 
4 12 22 12 0 0 


.48 
.63 


.52 
.49 


Control 


20-A 
16-B 


84 
82 


8 15 24 52 0 0 
5 20 48 24 1 2 


82 
84 


5 13 21 60 0 1 
7 10 60 24 0 0 


.46 
.42 


.46 
.58 



Table 174. Pretest to Posttest Changes 
(The response choice for 20-A is cited first.) 



Item Pa 


Lr 20-A, 16-B Percent Chanqe, Protest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D C D+C 


A B A+B 


B A B+A 


C D C+D 


Experi- 
mental 

Control 


+14 +19 +16 
+8 +12 +10 


+4 +3 +4 
-3 -10 -6 


-6 -1 -3 
-2 +2 0 


-13 -11 -14 
-3 0 --1 
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emphasize the difference between skin and muscle to avoid this problem. 
Biserial correlations are excellent for both experimental and control 
groups . 



WH.'r ^V' THE fiLOWlNG IS THE BtST PROTECTOR FOf HONES m jQihiy^ 
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Item pair 19-B functions at the cognitive level of comprehen- 

sion. Mean total gain from pretest to posttest for the experimental 
group was three percent. Mean total gain for the control group was 
11 percent (from 69 to 80 percent), thus we cannot attribute experi- 
mental group gains to the effect of instruction. Although the protective 

Table 175. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


22-A 
19-B 


78 
85 


79 5 4 12 0 0 
19 8 68 4 1 0 


85 
78 


80 7 7 6 0 0 
24 4 71 1 0 0 


.38 
.40 


.63 
.63 


Control 


22-A 
19-B 


84 
82 


70 10 6 12 2 0 
11 10 68 9 1 1 


82 
84 


74 4 7 13 0 1 
4 4 86 6 1 0 


.56 
.52 


.60 
.68 



Table 176. Pretest to Posttest Changes 
(The response choice for 22-A is cited first.) 



Item Pair 22-A, 19-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 




Parallel 


Distractof 


Pairs 






A C A+C 


B B 


B+B 


C 


D C+D 


D 


A 


D+A 


Experi- 
mental 


+x +3 +3 


+2 -4 


-1 


+ 3 


-3 0 


-6 


+5 


-1 


Control 


+4 +18 +11 


-6 -6 


-6 


+1 


-3 -1 


+1 


-7 


-4 
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function of bones is stressed in Unit III, the protective function of 
muscles could receive more eir^hasis. A 76 percent posttest achieve- 
ment level is satisfactory, however. Biserial correlations are high 
for both experimental and control groups. 




Item pair 24-A, 22-B functions at the cognitive level of comprehen- 
sion. Mecin total gain from pretest to posttest for the experimental 
group was eight percent (from 37 to 45 percent) . Mean total gain for 
the control group was four percent (from 36 to 40 percent), enabling 
us to attribute experimental group gains to the effect of instruction. 
It is evident from both the experimental and .control group results that 
EMH students in our sample probably do not think of a baseball mitt as 
a protective device for the hcmd, but rather something to facilitate 
catching the baseball. The 11 percent gain from 53 to 64 percent on 
Form B where the shoulder pads are the correct choice is satisfactory. 
Biserial correlations were satisfactory for both groups. 



Table 177. Item Responses amd Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


24-A 
22-B 


78 
85 


21 35 5 40 0 0 
14 52 32 1 0 0 


85 
78 


26 27 5 42 0 0 
4 64 28 1 3 0 


.20 
.47 


.54 

• 46 


Control 


24-A 
22-B 


84 
82 


31 24 14 29 2 0 
21 41 32 4 1 1 


82 
84 


27 29 6 35 0 2 
11 52 26 11 0 0 


.70 
.35 


.43 
.63 
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Table 178. Protest to Posttest Changes 
(The response choice for 24-A is cited first.) 



Item Pa 


ir 22-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A B A+B 


B C B+C 


C D C+D 


D A D+A 


Experi- 
mental 

Control 


+5 11 +8 
"4 +11 +4 

1 


-8 -4 -6 
+5 -6 -1 


0 0 0 
-8 +7 0 


+2 -10 -4 
+6 -10 -2 



Objective 301 . Students will associate senses with conscious and 
unconscious control of body activity . Three student activities and 
other instructional strategies were designed to develop student compe- 
tencies to achieve this objective. 

For activity 7, 75 percent of the teachers reported using the 
strategies as described; 25 x-rcent reported some modification. 
Ninety-four percent reported that the strategies were successful. 
Teachers' written comments for activity 7 consisted mainly of mention- 
ing additional items they added to the materials for the students to 
sarnie. Most agreed that the students were highly motivated. One 
pleasing response was, "This activity was too stimulative — perhaps 
one -sense- a day with more activities for each sense. One or perhaps 
the most exciting results of this program — for me — is the increased 
language development of 2401. He has the most primitive speech pattern 
of any child I have had ~ just never responds ~ and gee whiz ~ lately 
he has begun to talk , give ideas — many of which aren't bad — and 
this increased talking is carrying over into other parts of the school 
day. Thank you for Joe." 
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Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N=16j 



100 



50 



543215432154321 

Figure 90. Reaction of the majority of students 
to activity 7 

100 




5 = high 
3 = neutral 
' = low 



Percent 50 




I 



Percent of 
teachers 
(N=15) 



5 4 3 2 1 

Important > OK Useless 

Figure 91. Importance to students of activity 7 

Figure 90 shows that student reactions are exceptionally high 
across the three rating scales. One thing is becoming increasingly 
clear — EMH students enjoy doing activities themselves much more than 
watching demonstrations. Figure 91 shows that the vast majority of 
the teachers rated activity 7 as being very important. It is interest- 
ing to note that the teacher who rated the activity as "2" is the same 
teacher who did not follow the instructional strategies. 
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100 



50 - 



Percent of 
teachers 
(N=16) 




All A i i <i None 
4 2 4 4 

Figure 92. Proportion of 
students able to perform 
on sabobjectives of 
objective 301 



5 4 3 2 1 

Important OK * Useless 

Figure 93. Importance of the 
subobjectives 



Figure 92 shows that the proportion of students able to perform 
the behaviors specified in the seven subobjectives was relatively high, 
considering thv Jiat they were trying to identify objects in 

boxes, bottles, etc., without the use of sight. Ninety percent reported 
that one-half or more of their students identified all of the unknowns. 
Figure 93 shows that most teachers rated the seven subobjectives to be 
very important. 

For activities 8 and 9, 69 percent of the teachers reported using 
the strategies as described; 31 percent reported some modification. All 
teachers reported that the strategies were successful. Several minor 
problems were encountered m these activities. Some of the older students 
were very self-conscious about going through the school blindfolded, 
but the younger students thought it was a great experience. Several 
teachers set up artificial situations in classrooms instead of touring 
wirough the building. Another minor problem was encountered when 
teachers left the vials of butyric acid uncapped for long periods of 
time and the smell permeated entire school buildings. Ammonia was 
suggested as a substitute for sensitive noses. The reaction to the 
fi**m, Me and My Senses, was excellent. 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 
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Figure 94. Reaction of the majority of students 
to activities 8 and 9 
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I 



Percent of 
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100 
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Figure 95. inportance to students of activities 8 and 9 
Figure 94 shows that student reactions were again very high across 
the three rating scales. Most low ratings occurred because of objec- 
tional smells, such as butyric acid. Figure 95 shows that teachers 
rated the activities important for EMH children. 

Figure 96 shows that the success rate on performing specified 
subobjectives was high. Eighty-six percent of the teachers reported 
that three-fourths or more of their students were able to perform the 
specified behaviors; 96 percent reported that one-half or more were, 
successful. Figure 97 shows that teachers reported that the subobjec- 
tives are important. 

100 




I 



50 -, 



Percent of 
teachers 
(N=16) 




All 1 i i <i None 
4 2 4 4 



Figure 96. Proportion of 
students able to perform 
on subobjectives of 
objective 301 
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Figure 97. Importance of the 
subobjectives 



Four item pairs were designed to sample achievement on this 
objective. 
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WHAT IS THE EASIEST v"\y TO TELL WHA: THIS AHlf^AL !S, SMELLlflG, 
TASTI'.G. TOUCHING. 




2«i 

WHAT IS THE EASIEST WAY TO TELL WHAT COLOR THIS APPLE IS. TOUCHING. 
SEEING. SMELLING, TASTING'' 




«W X ON TX M(fiS YOCi CHOOSE. 



S1ELLING 




TASTING 


I 

1 TOUCHING 




HEARING 


A 


a 


c 


0 



hWK m X ON T>€ ORD YOU CMOOSE. 
* B 



TOUCHING 



SEEING 



J 



SNELLING 



TASTING 



Item pair 1-A, 24-B functions at the cognitive level of knowledge 

and was judged to provide baseline information. Mean net gain from 

pretest to posttest for the experimental group was two percent (from 

88 to 90 percent) . There was no gain from pretest to posttest for the 

control group. Although the gain for the experimental group is low, 

this is to be expected where pre+-.est acnievement levels are high, it 

Table 179. item Responses and Biserial Correlations 
for Ejcperimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C J) M 0 


A B C D M 0 


Pre 


Post 


E5cperi- 
mental 


1"A 
24-B 


78 
85 


90 3 6 1 0 0 
1 87 1 11 0 0 


85 
78 


94 1 5 0 0 0 
1 86 3 9 1 0 


.61 
.50 


.68 
.47 


Control 


1"A 
24-B 


84 
82 


90 2 5 2 0 0 
2 76 7 11 1 2 


82 
84 


87 1 9 2 1 0 
1 80 4 15 0 0 


.55 
.76 


.49 
.54 



Table 180. Pretest to Posttest Changes 



Item Pa J 


Lr 1-A, 24-B Percent Chanqe. Pretest ^o Po?;f>PQ+. 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A B A+B 


3 D B+D 


C A C+A 


D C D+C 


Experi- 
mental 

Control 


+4 -1 +2 
-3 +4 0 


-2 -2 -2 
-1 +4 +2 


-10 0 
+4 -1 -HI 


-1 +2 0 
0 -3 -1 
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is evident that students recognize single senses which are involved 
in identifying different objects. Biserial correlations vere excellent 
for both the experimental and control groups, 

^^Vi YOU L'SED T^-: STAPC^ TEST SOLUTION *MC- Tr[ ?CILCWIN5 f^^Vi iC-K UMD T-L A'GAP TiGT :r'JJ'IO'. i.MC^' ?r T>.f PrLLn.^!'JG :2& 

i'il^i: "01 TELL IF STANCH WAS PRESEM^ .^pf^ ^q., ^^^^p ^^.r optSLNT^ 

© '•^ cli I 9 

Item pair 7-A, 12-B functions at the cognitive level of comprehen- 
sion. Mea\ net gain from pretest to posttest for the experimental group 
was three percent (from 54 to 57 percent). Mean net gain for the control 
group was also three percent, but the response patterns were more random 
and weighted toward the use of taste as an identifying sense. This was 
a difficult item pair because it involved the recall of starch and sugar 
y testing from Unit I and the association of a sense with the results of 

the Unit I activity. In view of this difficulty, 57 percent is considered 
to be an excellent level of achievement. Biserial correlations for the 
experimental group were excellent and indicate stron^gly that there was 
an i^ffect due to instruction on this item pair. 



Table 181. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


7-A 
12-B 


78 
85 


5^ 3 5 37 0 0 
52 12 4 31 1 0 


85 
78 


60 2 7 31 0 0 
53^ 0 1 45 10 


.54 
.67 


.67 
.64 


Control 


7-A 
12-B 


84 
82 


40 12 19 27 1 0 
13 4 7 74 1 0 


82 
84 


3^ 2 18 43 0 1 
26 4 1 68 1 0 


.63 
.40 


.04 
.65 




ERIC 



199 



Table 182. Pretest to Posttest Changes 
(The response choice for 7-A is cited first.) 



Item Pa. 


7-A, 12-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A A A+A 


B C B+C 


C B C+B 


D D D+D 


Experi- 
mental 

Control 


+5 0 +3 
-5 +13 +3 


-1 -3 -2 
-10 -6 -9 


+2 -12 -5 
-1 0 -1 


-6 +14 +4 
+16 -6 +6 



12a 



WHICH OF THE FOILOW!% 15 A 'MSi SPITTING. DR|H^ING. EATING,. 
TASTlNri-J 

fiUK «1 X nN THE iOQ> ^OU OOOSE. 



w.iCM THf FntLOWiNr, IS A SENSE CPYlNG. SEEING, w!^:<!HG. ELlMKlrjG'> 



SPlTTIftG 



EATING 



TASTING 



BLINKING 



Item pair 12-A, 1-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest for the experimental group was 
34 percent (from 47 to 81 percent) . Mean net gain for the control group 
was three percent (from 50 to 53 percent) . These results clearly indi- 
cate that the experimental group gains can be attributed to the effect 
of instruction. The gains can be accounted for by losses on all other 
response choices, except f >r a gain of three percent on drinking in 
Form A. Biserial correlations approach the phenomenal level for both 

Table 183. Item Responses and Biserial Correlations 
for Ejperimental and Control Groups 



Student 
Group 


Iteji 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Eaperi- 
mental 


12-A 
1-B 


78 
85 


13 8 31 49 0 0 
26 £6 6 21 1 0 


85 
78 


4 11 11 75^ 0 0 
4 8£ 5 2 0 0 


.67 
.23 


.71 
.89 


Control 


12-A 
1-B 


84 
82 


15 10 20 55 0 0 
15 45 20 21 0 0 


82 
84 


13 30 9 46 0 1 
17 60 8 15 0 0 


.58 
.41 


.68 
.56 
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Table 184. Pretest to Posttest Changes 
(The response choice for 12-A is cited first.) 



Item Pair 12-'A, 1-B 


Percent Change, Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor 


Pairs 




D B D+B 


A A A+A 


B C B+C 


C D 


C+D 


Experi- 
mental 


+26 +42 +34 


-9 -22 -16 


+ 3 -1 +1 


-20 -19 


-19 


Control 


-9 +15 +3 


-2 +2 0 


+20 -12 +4 


-11 -6 


-8 



items in the ea^erimental and control groups. The enthusiasm generated 
during activities involving the senses seems to have had an effect on 
learning. 



:6a 



WHICH SENSES HELPED PAT PW*ifJ HIS TEL£PKO:iE M*ti^r 

WD num. TASTir;6 M'J Sf*£LLI!l&. VUiWj WAUr,. WH^l'i': 

AID SEEINft^ 



w-^ic- ^Viiv '-iiPit i^AY ^i^im^ fie AMss Him% m 

^tUr^ SiEIffj AND TASTI'jfi., TASTI'iy AND V^UVMQ. SMELLING AND 
APING'S 

AN X ON THt 80/ WITH Trtt k^XO^ VCO CHOOSE, 



SEEir^r, wd! 



TASTINf 



. TASTlNf, A!iD, 
• SflELLIHG , 



■SMELL I «6 WD 
MEA»lN^i 



;H£Af)lrj''i Af<D 
SEEING • 



HfA^'NG A'JD 3rE!HG AND 



G-ElLiNG 



S«£LL!flG AND 

HEAf^ittn 

' "5 



Item pair 16-A, 4-B functions as the cognitive level of knowledge 
and provides baseline information concerning the use of senses in 
remembering. Mean total gain from pretest to posttest for the experi- 
mental group was six percent (from 83 to 89 percent). Mean net gain 
for the control group was four percent (from 73 to 77 percent). 



Table 185. Item Responses and Biserial Correlations 
for E3cperimental and Contiol Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


16-A 
4-B 


78 
85 


3 3 8 87 0 0 
79 6 2 13 0 0 


85 
78 


1 2 7 88 0 1 
90 5 3 3 0 0 


.59 
.54 


.79 
.64 


Control 


16-A 
4-B 


84 
82 


8 4 5 83 0 0 
63 15 7 13 0 1 


82 
84 


6 5 10 78 0 1 
77^ 10 4 10 0 0 


.21 
.67 


.56 
.77 
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Table 186. Pretest to Posttest Changes 
(The response choice for 16-A is cited first.) 



Item Pair 16-A. 4-B 


Percent Change^ 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 




D A D+A 


A B A+B 


B 


C 


B+C 


C D 


C+D 


E3<peri- 
mental 


+1 +11 +6 


-2 -1 -2 


-1 


+1 


0 


-1 -10 


-6 


Control 


-5 +14 +4 


-2 -5 -3 


+1 


-3 


-1 


+5 -3 


+1 



Although gains were registered by both groups, we attribute experi- 
mental group gains to the effect of instruction. Biserial correlations 
are excellent for both groups. 



Objective 302 . Students will associate the brain with control of 
body activity . Three activities and other instructional strategies were 
designed to develop student competencies to achieve this objective. 

For activities 10 and 11, 69 percent of the teachers reported that 
they used the strategies as described; 31 percent reported some modifi- 
cation. Ninety-four percent of the teachers reported that the strategies 
were successful and six percent reported that they were unsuccessful. 
Some minor problems were encountered in cutting out and assembling the 
puppets, but improved art and instructions should correct this in the 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N=16) 



100 



50 - 




5 = high 
3 = neutral 
1 = low 



5 4 3 2 



5432154321 



Figure 98. Reaction of the majority of students 
to activities 10 and 11 
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revised materials. In lesson 11 one teacher wrote, "We got into a dis- 
cussion of voluntary and involuntary movement that was worthwhile. The 
kids greatly enjoyed relating their personal experiences and identifying 
their own body functions with the subjects under disciassion." 

Figure 98 shows that student reactions were high across the three 
rating scales / but not as high as on previous activities. Figure 99 
shows that teachers considered the activities to be important. 



100 



Percent 50 - 




I 



5 4 3 2 1 
Important » OK Useless 



Percent of 
teachers 
(N=16) 



Figure 99. Importance to students of activities 10 and 11 
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Percent of 
teachers 
(N=16) 



73 
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All 3 j, jL .1 None 
4 2 4 4 



5 4 3 2 1 

Important OK > Useless 

Figure 101. Importance of the 
subob jectives 



Figure 100. Proportion of 
students able to perform 
on subobjectives of 
objecti\^e 302 

Figure 100 shows the average across the seven subobjectives of the 
proportion of students who were able to perform the desired behaviors. 
Seventy-eight percent of the teachers reported that three-fourths or 
more of their students could perform the desired behaviors; 93 percent 
reported that one-half or more of their students were successful. These 
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levels should increase with the use of the f'onctioning torso in the 
revised materials. Figure lOl shows that teachers considered the sub- 
objectives to be important. 

For activity 12, 81 percent of the teachers reported using the 
strategies as described; 13 percent reported some modification; and 
six percent reported much modification. Ninety-four percent reported 
that the strategies were successful and six percent reported that they 
were unsuccessful. Some teachers reported that students would not 
trust them after eating the bittersweet chocolate. One suggested that 
a square of sweet chocolate should be offered after the deception of the 

bittersweet chocolate. 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 

100 



Percent of 
teachers 
(N=15) 



50 




high 

neutral 

low 
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.Figure 102. Reaction of the majority of students 

to activity 12 
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I 



Percent of 
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5 4 3 2 1 

Important OK » Useless 

Figure 103. Importance to students of activity 12 

Figure 102 shows that student reactions to activity 12 were high 
across the three rating scales. Figure 103 shows that teachers con- 
sidered activity 12 to be important. 
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Figure 104 shows that 77 percent of the teachers reported that 
three-fourths or more of their students could perform the desired 
behaviors specified in the subob jectives . Ninety-seven percent re- 
ported that one-half or more of their students were successful. 
Figure 105 shows that teachers considered the svibob jectives to be 




All 1 i i <i None 
4 2 4 4 
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Figure 104. Proportion of 
students able to perform 
on subob jectives of 
objective 302 



5 4 3 2 1 
Important OK Useless 

Figure 105. Importance of the 
subob jectives 



Eight item pairs were designed to assess student achievement on 
objective 302. 

WHAT CAfi<*lES »l£SSAGES F»OK THE SENSES TO THE BMlN. BLOOD /fSSElS. WHAT CAO«>ILS -ES'iAGiS fROW THf SLNSLS TO ThL i-PA!'i, NifV''. 15fc 

NEPVES., BONES. WJPES'' IflTL:TlN£S. ELOOL VESSELS., W!P£:'> 

fWht X TX WTO /OU oast. PVP* « / QhTMt iCTO 0«K£ 



BLOODVESSELS! I HimS 1 ! BONES , WIRES | '■^'^VCS ' INTESTINES : BLOOD VE'.SELS , HlPES . 
' ' ; ' ' 1 ' >- ' - A ' ^ i ' ' c, ■ ' ' t 



Item pair 4-A, 13-B functions at the cognitive level of knowledge. 
Mean total gain from pretest to posttest for the experimental group was 
33 percent (from 46 to 79 percent). Mean total gain for the control 
group was seven percent (from 54 to 61 percent) . Experimental group 
gains are attributed to the effect of instruction and can be accounted 
for by losses in all other response choices. The achievement level on 
this item was excellent. Biserial correlations are excellent for both 
groups . 
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Table 187- Item Responses and Biserial Correlations 
for Experimental and Control Groins 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


V 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


4-A 
13-B 


78 
85 


41 41. 6 12 0 0 
5]^ 5 35 8 1 0 


85 
78 


9 85 1 4 1 0 
73 1 17 8 1 0 


• 49 

• 51 


.76 
• 65 


Control 


4-A 
13-B 


84 

82 


13 67 12 8 0 0 
40 18 26 16 0 0 


82 
84 


29 54^ 5 11 0 1 
62 10 11 12 1 0 


.46 
• 63 


• 42 

• 63 



Table 188. Pretest to Posttest Changes 
(The response choice for 4-A is cited first.) 



Item Pair 4-A, 13- 


-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 






B A 


B+A 


A C A+C 


C 


C C+C 


D 


D 


D+D 


Experi- 
mental 


+44 +22 


+ 33 


-32 -18 -25 


-5 


-18 -12 


-8 


0 


-4 


Control 


-13 +27 


+7 


+16 -15 +1 


-7 


-15 -11 


+3 


-4 


0 



WHAT PART Of THE BODY DIRECTS PHYSICAL ACTIVITY' 8a Vr^A! -^''-^ rc t ir-^ COM^'/: '^t^KlltM .TiIVITY^ 




Item pair 8-A, 9-B functions at the cognitive level of comprehen- 
sion^ Mean total gain from pretest to posttest for the experimental 
group was five percent (from 57 to 62 percent). Mean total gain for the 
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Table 189, item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent ot N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
ment al 


8- A 

9- B 


78 
85 


8 21 17 55 0 0 
14 16 12 58 0 0 


85 
78 


6 16 20 52 0 0 
15 9 9 67 0 0 


• 59 

• 56 


• 45 

• 69 


Control 


8- A 

9- B 


84 
82 


6 19 18 56 0 1 
20 20 18 28 2 2 


82 
84 


17 15 16 51 0 1 
14 15 13 52 0 0 


• 66 

• 62 


• 41 

• 72 



Table 190, Pretest to Posttest Changes 
(The response choice for 8-A is cited firsts) 



Item Pa. 


Lr 8-A, 9-B Percent Change, Pretest to Posttest 


Student 
Grotp 


Correct 
Choice 


Parallel Distractor Pairs 


D D D+D 


A B A+B 


B A B+A 


C C C+C 


Experi- 
mental 

Control 


+ 3 +9 -J5 
-5 +19 +7 


-2 -7 -5 
+11 -5 +3 


-5 +1 -1 
-4 -6 -5 


+ 3 -3 +1 
-2 -5 -4 



control group was seven percent (from 47 to 54 percent) . Because of the 
control group gains, the gains of the experimental group cannot be attrib- 
uted to the effect of instruction. Teacher comments and interviews with 
students indicate that the words "directs physical activity" are not 
understood cy the students. The revised tests were subsequently changed 
to "which part of the body controls your muscles." Both pretest and 
posttest biserial correlations were very high. 



Item pair lO-A, 25-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest for the experimental group 
was five percent (from 41 to 46 percent) . There was a mean net loss of 
one percent (from 37 to 36 percent) for the control group, enabling us to 
attribute the experimental group gains to the effect of instruction. This 
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conclusion is also verified by the shift in biserial correlations from 



pretest to posttest for the experimental group. Students with visual 
reception problems probably encountered difficulties with this item 
pair because of the rature of the visual task of tracing the nerve from 
Table 191. Item Responses and Biserial Correlations 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


10-A 
25-B 


78 
B5 


19 37 36 6 1 0 
19 44 27 5 6 0 


85 
78 


15 42 39 2 1 0 
13 50^ 26 9 3 0 


.33 
.43 


.32 
.66 


Control 


10-A 
25-B 


84 
82 


17 45 23 13 2 0 
12 29 32 22 5 0 


82 
84 


26 22^ 40 9 4 0 
8 4 9 32 8 2 0 


.20 
.51 


.18 
.57 



Table 192. Pretest and Posttest Changes 



Item Pa. 


Lr 10-A, 25-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B B B+B 


A A A+A 


C C C+C 


D D D+D 


Experi- 
mental 

Control 


+5 +6 +5 
-23 +20 -1 


-4 -6 -5 
+9 -4 +2 


+ 3 -1 +2 
+17 0 +9 


-4 +4 0 
-4 -14 -9 



the arrow point back to the brain. This stylized hvunan figure was 
dropped from the revised test because student achievement was much 
better on a more realistic figure (see item pair A-25, B-7) , 
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Item pair 15-A, 5-B functions at the cognitive level of analysis. 
Mean total gain from pretest to posttest for the experimental group was 
25 percent (from 50 to 75 percent). Mean total gain for the control 
group was 19 percent (from 40 to 59 percent). We attribute the 
experimental group gains to the effect of instruction and they can be 
accounted for by losses on all other response choices. This item shows 
very good growth in terms of knowledge of the function of the brain. 



Table 193. item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


15-A 
5"B 


78 
85 


33^ 4 3 55 5 0 
15 9 64 8 2 1 


85 
78 


b6 4 1 26 2 1 

5 5 85 0 5 0 


.41 
.37 


.45 
.82 


Control 


15-A 
5"B 


84 

82 


32_ 14 7 43 4 0 
27 17 48 4 4 1 


82 
84 


41 10 1 37 10 1 
8 6 75_ 7 4 0 


.48 
.68 


.64 
.73 



Table 194. Pretest to Posttest Changes 
(The response choice for J 5-A is cited first.) 



Item Pair 15-A, 5-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 




A C A+C 


B D B+I) 


C 


A 


C-^A 


D B 


D+B 


Experi- 
mental 


+33 +21 +25 


0 -8 -4 


-2 


-10 


-6 


-29 -4 


-15 


Control 


+9 +27 +19 


-4 +3 -1 


-6 


-19 


-12 


-6 -11 


-9 
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Biserial correlations are very high for both forms of tne test and for 
both the pretest and the posttest* 




Item pair 17-A, 17-B functions at the cognitive level of comprehen- 
sion and WHS judged to provide baseline information. There was a mean 
net loss from pretest to posttest for the experimental group of five 
percent (from 79 co 1^. percent). There was a loss of two percent (from 
78 to 76 percent) for the control group. The BSCS staff recommended 
that this item be replaced because of inherent problems in the illustra- 
tions used. 



Table 195. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



- 

student 
Group 


n 

Item 
# 


N 


Pretest 


Posttest 


^b 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


17-A 
17-B 


78 
85 


5 4 64 27 0 0 
4 93 4 0 0 0 


85 
78 


2 2 54 41 0 0 
1 9£ 1 1 1 1 


.47 
.41 


.47 
.83 


Control 


1-/-A 
17-B 


84 
82 


6 1 63 30 0 0 
2 94 2 0 0 1 


82 
84 


1 4 52 38 0 0 
0 95_ 2 1 1 0 


.20 
.37 


.44 
.84 



Table 196. Pretest to Posttest Changes 
(The response choice for 17-A is cited first.) 



Item Pair 17-A, 17-B 


Percent Change, 


Pretest to 


Posttest 




student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 




C B C+B 


A A A+A 


B 


D 


B+D 


D C 


D+C 


Experi- 
mental 


-10 +1 -5 


-3 -3 -2 


-2 


+ 1 


0 


+14 -3 


+6 


Control 


-6 +1 -2 


-5 -2 -4 


+ 3 


+ 1 


+1 


+ 8 0 


+4 
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Item pair 19-A, 21-B functions at the cognitive level of comprehen- 
sion and is judged to provide baseline information. Mean total gain 
from pretest to posttest for the experimental group was eight percent 
(from 72 to 80 percent) . Mean net gain for the control group was 
three percent (from 80 to 83 percent). Because of the greater improve- 
ment, we attribute the experimental group gain to the effect of 
instruction and account for the gains by losses on all other response 
choices. Biserial correlations indicate that both items are excellent 
discriminators . 

Table 197. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


19-A 
21-B 


78 
85 


4 3 68 24 0 1 
14 76 4 5 1 0 


85 
78 


1 2 81 15 C 0 
12 79 3 6 0 0 


.27 
.24 


.54 
.34 


Control 


19-A 
21-B 


84 

82 


2 0 76 19 2 0 
7 84 0 7 1 0 


82 
84 


2 2 87 7 0 1 
14 80 2 4 0 0 


.54 
.42 


.47 

.70 



Table 198. Pretest to Posttest Changes 
(The response choice for 19-A is cited first.) 



Item Pair 19-A, 21-B Percent Change Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C B C+B 


A D A+D 


B C B+C 


D A D+A 


Experi- 
mental 

Control 


+13 +3 +8 
+ 11 -4 +3 


-3 +1 -2 
0 -3 -1 


-1 -1 -2 

+2 +2 +2 


-9 -2 -5 
-12 "7 -2 
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Item pair 23-A^ iS-B functions at the cognitive level of comprehen- 
sion and was judged to provide baseline information. Mean net gain from 
pretest to posttest for the experimental group was 14 percent (from 79 
to 93 percent) • Mean net gain for the control group was 4 percent (from 
72 to 76 percent) • We can therefore attribute the experimental group 



Table 199. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


23-A 
15-B 


78 
85 


8 3 12 78 0 0 

9 5 6 80_ 0 0 


85 
78 


0 0 4 96 0 0 
4 5 0 90 1 0 


.74 
.49 


.71 
.87 


Control 


23-A 
15-B 


84 
82 


7 10 6 76 1 0 
17 7 6 67 0 2 


82 
84 


9 6 10 73 0 2 
12 5 4 80^ 0 0 


.56 
.68 


.64 
.64 



Table 200. Pretest to Posttest Changes 
(The response choice for 23-A is cited first.) 



Item Pair 23-A, 15-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Dis tractor 


Pairs 




D D D+D 


A A A+A 


B 


B B+B 


C C 


C+C 


Experi- 
mental 


+18 +10 +14 


-8 -5 -7 


-3 


0 -2 


-8 -6 


-7 


Control 


-3 +13 +4 


+2 -5 -1 


-4 


-2 -3 


+4 -2 


+1 
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gains to the effect of instruction. For the experimental group, losses 
occurred on all response choices except the correct choice, it is 
evident that the role of the brain is emphasized in ME NOW and that 
the students have learned its role. Biserial correlations are out- 
standing for both groups. 




Item pair 25-A, 7-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest for the experimental group 
was 15 percent (from 46 to 61 percent). There was a mean net loss of 
five percent (from 42 to 37 percent) for the control group, enabling us 
to attribute experimental group gains to the effect of instruction. 
Student achievement was much better with this illustration than with 
the less realistic one utilized in item pair 10-A, 25-B. Biserial 
correlations indicate that both items are good discriminators. 

Table 201. Item Responses and Biserial Correlations 



for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Prt 


Post 


Experi- 
mental 


25-A 
7-B 


78 
85 


5£ 22 14 10 4 0 
42 13 34 8 2 0 


85 
78 


56 20 13 4 5 2 
67 14 15 1 3 0 


.64 
.45 


.48 
.61 


Control 


25-A 
7-'B 


84 
82 


43 20 20 15 1 0 
30 13 29 24 2 0 


82 
84 


41 28 17 10 2 1 
44 14 27 12 2 0 


.41 
.60 


.38 
.46 
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Table 202 • Pretest to Posttest Changes 
(The response choice for 25-A is cited first.) 



Item Pair 25-A, 7-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Dis tractor 


Pairs 




A A A+A 


B B B+B 


C 


C 


C+C 


D D 


D+D 


Ejcpe ri- 
me ntal 


+6 +25 +15 


-2 +1 0 


-1 


-19 


-10 


-6 -7 


-6 


Control 


"13 +3 -5 


+8 +1 +4 


-3 


-2 


-2 


-5 -12 


-8 



Objective 303 . Students will associate sensory perception with 
lecurning and behavior. Three student activities and other instructional 
strategies were designed to develop student competencies to achieve 
this objective. 

For activities 13 to 15, 75 percent of the teachers reported that 
they used the strategies as described; 25 percent reported seme modifi- 
cation. Ninety-four percent reported that the strategies were successful. 
Teacher comments indicated that the students were highly motivated in 
this sequence of activities. One typical report was, "Boys 3104 and 
3106 were invited into the primary EMR room to conduct a lesson with 
the youngsters. They did a tremendous job — and with very little help 
from the room teachers, carried the project all the way — even to 
directing and helping the little ones to make their own ink blots." 

Another teacher reported, "Activity #13 was really valuable not 
only scientifically but also psychologically and socially. There 
were all kinds of information available not only to the students but 
to the teacher about the students. So far I am so pleased with this 
program that it is unbelievable. Unit III is really great. I feel 
that a real contribution has been made to my field." 
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Some ndnor problems occurred in obtaining the film, Garbage , but 

instructions on ordering in the revised materials should eliminate this 

problem. Some teachers reported that a few students were frustrated by 

the maze, but most of them handled it successfully. 

Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 

Percent of 
teachers 50 
(N=16) 




5 = high 
3 - neutral 
1 = low 



543215432154321 
Figure 106. Reaction of the majority of students to activities 13 to 15. 

Figure 106 shows that student reactions to the activities were very 
high across the three rating scales. Figure 107 shows that teachers 
rated the activities as very important for EMH students. 



100 



Percent 50 




I 



Percent of 
teachers 
(N=15) 



7 7 
5 4 3 2 1 
Important OK ^ Useless 

Figure 107. Importance to students of activities 13 to 15. 
Figure 108 shows that students were very successful in these 
activities. Seventy-seven percent of the teachers reported that 
three-fourths or more of their students were able to perform the 
desired behaviors in the three svibobjectives; 97 percent reported 
that one-half or more of their students were successful. Figure 
109 shows that teachers considered the subobjectives to be important. 
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100 



50 




100 



I 



Percent of 
teachers 
(N-16) 




All 2 1. 1 .1 None 
4 2 4 4 



Figure 108. Proportior of students 
able to perform on subobjectives of 
objective 303. 



5 4 3 2 1 
Important < OK ^ Useless 

Figure 109 • Importance of 
the subobjectives* 



Four item pairs were designed to assess student achievement on 
objective 303. 



WHICH OF THE FOLLOWING COULD BE TRUE FOR THIS FIGURE- A BOX IN 
A CORNER, A CORNER CUT OUT OF A BOX.. NEITHER CHOICE.. BOTH CHOICES. 

fVfiK AN X ON TH£ BOX *tirn VOUR 0C1C6. 




A BOX !N ^ A CnPN£P CUTj 
A COPNEO nilT A BOX, 



NEITHER BOTH 
CHOICE CHOIC":^ 



Item pair 5-A, 6-B functions at the cognitive level of analysis. 

For the experimental group there was a mean net loss from pretest to 

posttest of 11 percent (from 35 to 24 .percent) . For the control group 

there was a mean net gain of 11 percent (from 19 to 30 percent) . For 

both groups the response pattern appeared to be that of random responses. 

Table 203. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent cf N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


5- A 

6- B 


78 
85 


47 19 5 26 1 1 
24 29 2 44 0 0 


85 
78 


53 21 4 21 0 1 
27 36 9 22 0 0 


.18 
.09 


.15 
.30 


Control 


5- A 

6- B 


84 
82 


45 29 7 1^ 2 1 
28 35 9 23 5 0 


82 
84 


44 23 7 22 1 2 
26 24 7 38 5 0 


.20 
.08 


.18 
.48 
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Jiphle 204. Pretest to Posttest Changes 
(The respon'^e choice for 5-A is cited first.) 



Item Pair 6-B 


Percent 


Change, Pretest 


to PosLtest 




Student 
Group 


Correct 
Choice 






Parallel Distractor 


Pairj 






D D D+D 


A 


A 


A+A 


B B 


B+B 


C 


C 


C+C 


Experi- 
mental 


-5 -17 -11 


+6 


+3 


+4 


+2 +7 


+4 


-1 


+ 7 


+3 


Control 


+ 7 +15 +11 


"1 


-2 


-2 


-6 -11 


-8 


0 


-2 


-1 



The shading on the box should be improved and it appears that more 



emphasis should be placed on this type of activity for the revised 
materials. 



IT TOOk FO£D 30 riM'TES TO GREASE THE CAR FQP M FIPST T!*1E 9* 
A \tAq LAT£S H[ AGAl^ GREASE2 THE CAP. WHIG" LENGTH OF TI»1E 
S-'^^sS THAT FP£: HAD PRACTICED'' 

"V*. AT* A OV IH BOX w;t>< Th£ Tit YOy CHOOS£, 



i'JB 

'T Tan^ m oj' mm'. 10 "^at a fuiton hole fop the fip'^t iif^f. 

A vfA» LAT-c -Ht •'^i^f ft »iiTTON HOLE WH^H LENGTH Of Tlf^t 

:'*p* ift > Thi K - r.ITM THE "^Ju CHOOSE 

' :0 riNMir 2^ "iNUTr: 30 MINUTES | , ^lO «!NUTES 

* h L " ' i ' 



Item pair 9-A, 10-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest for the experimental group 
was 12 percent (53 to 65 percent) while the gain for the control group 
was 16 percent (from 48 to 64 percent). Inspection of gains and biserial 



Table 205. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


9-A 
10-B 


78 
85 


26 12 10 52 0 0 
52 15 6 26 0 0 


85 
78 


14 8 12 65 0 1 
6£ 8 12 17 0 0 


.66 
.49 


.54 
.53 


Control 


9-A 
10-B 


84 
82 


27 10 21 40 1 0 
5i7 9 6 24 2 1 


82 
84 


26 12 10 51 0 1 
76 8 4 11 1 0 


.54 
.56 


.61 
.78 
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Table 206. Pretest to Posttest Changes 
(The response choice for 9~A is cited first.) 



Item Pair 10-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D A D+A 


A D A+D 


B C B+C 


C B C+B 


Experi- 
mental 

Control 


+12 +11 +12 
+11 +19 +16 


-12 -9 -10 
-1 -13 -8 


-4 +6 +1 
+2 -2 0 


+2 -7 -3 
-11 -1 -6 



correlations lead us to hypothesize that instruction covering this topic 
occurred in the control group. Regardless of whether or not the experi- 
mental group gains can be attributed to the effect of instruction, they 
were significant and we are satisfied with the level of achievement. 



r TOOK THF" thl p;cst A';: r ':" - 



"JlfH,, S[V,, T0»1 ANr CAPOL IK^ TF!L: Two Tl-LS in G[] \^m\UW A 
HHUSf OF "^IPPf^PS AT THf CAPMVAL TriL fOLLOWlNG TELLS HOW LONG 



I'lN 'Tlj Tut 



"^!% rT£t, sr* >t 



<^\l1TH 3 



in"' 
CAPOL 



Item pair 14-A, 8-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest for the experimental group 
was six percent (from 36 to 42 percent), while the gain for the control 
group was nine percent (from 35 to 44 percent). This is an Alternative 

Table 207. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


14-A 
8-B 


78 
85 


29 14 33 18 0 5 
39 14 27 15 2 2 


85 
78 


29 13 35 15 Q 7 
50 10 21 15 1 3 


.31 
.19 


.50 
..40 


Control 


14-A 
8-B 


84 
82 


27 13 12 23 1 4 
39^ 20 13 22 4 2 


82 
84 


23 13 46 13 0 4 
42 18 19 15 0 6 


.40 
.03 


.38 
.57 
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Table 208- Pretest to Posttest Changes 
(The response choice for 14-A is cited first.) 



Item Pair 14-A, 8-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Dis tractor Pairs 


C A C+A 


A C A+C 


B D B+D 


D B D+B 


Experi- 
mental 

Control 


+2 +11 +6 
+ 14 +3 +9 


0 -6 -3 
-4 +6 +1 


-1 0 -1 
0 -7 -3 


-3 -4 -3 
-10 -2 -6 



form for presenting data similar to the previous item pair, but this 
system appears to be more difficult for the EMH students to interpret. 
Learning did occur in both the experimental and control groups. 



HAL SAYS THIS IS fl KEyt.\L. jg* 
POY SfiVS THIS IS fl P£AR. ▲ 
DICK SAYS This IS AN ACORfJ. ■ 
Jl^ SAYS THIS IS A m, 

WHICH PEOPLE COt'LD 3£ RIGHT nm£ OF THL PEOPLE, ALL OF Th£ PiOPd. 

JUST OQY AND DICK. JUST HAL AND Jl1'> 

1*R< *N X ON th£ box hitm thE people who COULC K HK.mT. 



V'TA .iY: T i: IE A =A?BIT, » 20b 

^AYS THIS iS A DuC» . 
M^sv MS IS iCl ALLIWTOc. 
ALI^[ SAYS THi:. IS A CAT[PPILLA0. 
W'-I'H profit COJlI; E[ Fi!C»iT '0N[ 0^ Tf^I ^EHPLL AU 0^ 1^1 FlOPLt.. 
J'/' ViT; AND ALICl. JijST S^IRLlY A!C r'APV 



( 



I NONE OP I 
I THE PEOPLE 
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I THE PEOPLE , 
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' m Die*; I 



JUST HAL 

1 Arji' n'* 



r.ov: Of ALL 0^ 



j'jsT vn; 
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JL'ST 'IHIPIFY 
AND rAPY 



Item pair 18-A, 20-B functions at the cognitive level of evaluation. 

Mean net gain from pretest to posttest for the experimental group was 

13 percent (from 12 to 25 percent), while gain for the control group was 

two percent (from 15 to 17 percent). We attribute the experimental 

Table 209. Item Responses and Biserial Correlations 
for Experim€^ntal and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


18-A 
20-B 


78 
85 


26 1£ 15 45 1 1 
40 L2 31 14 4 0 


85 
78 


19 28 21 32 0 0 
44 21 24 10 1 0 


-.38 
-.12 


• 07 

• 14 


Control 


18-A 
20-B 


84 
82 


31 17 14 36 2 0 
38 13 22 18 6 2 


82 
84 


24 2^ 22 27 4 1 
44 13 26 17 0 0 


-•29 
• 28 


• 41 

-.08 
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Table 210. Pretest to Posttest Changes 
(The response choice for 18-A is cited first.) 



Item Pair 18-A, 20-B 


Percent Change, 


Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel 


Distractor 


Pairs 




B B B+B 


A A A+A 


C 


C 


C+C 


D D 


D+D 


Experi- 
mental 


+16 +9 +13 


-7 +4 -2 


+6 


-7 


-1 


-13 -4 


-8 


Control 


+5 0 +2 


-7 +6 0 


+ 8 


+4 


+6 


-9 -1 


-5 



grovp gains to the effect of instruction, but the low level of achieve- 



ment indicates that more emphasis should be placed on helping students 
understand that it is possible for each person to view a figure and 
interpret differently than any otlier person. 



WHICH IS A PAPT Of THE DIGESTIVE SYSTE"'' 21a i: ; OF K_ -ir^. Wi'iG CVJ-I'' 




One item pair, 21-A, 18-B is an item measuring achievement from 
Unit I to determine if students are remembering information from last 
Fall. 



Table 211. Item Responses and Biserial Correlations 
for Experimental and Control Groups 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


21-A 
18-B 


78 
S5 


6 23 60^ 10 0 0 
8 2 10 79 0 0 


85 
78 


7 28 52 12 0 0 
5 1 3 91 0 0 


.55 
.60 


.55 
.60 


Control 


21-A 
18-B 


84 
82 


8 35 3^ 23 0 0 
7 10 13 £7 0 2 


82 
84 


7 32 41 17 0 2 
7 5 7 80 1 0 


.38 
.48 


.56 
.22 



ERIC 
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Table 212. Pretest to Posttest Changes 
(The response choice for 21-A is cited first.) 



Item Pair 21-A, 18-B Percent Change, Pretest to Posttest 



Student 
Group 



Experi- 
mental 

Control 



Correct 
Choice 



C+D 



-1 +12 +2 
+6 +13 +10 



Parallel Distractor Pairs 



A+A 



+ 1 -3 -1 
-1 0 -1 



B 



B B+B 



+5 -1 +3 
-3 -5 -5 



D+C 



+2 -7 -2 
"6 -6 -6 



Item pair 21-A, 18-B functions at the cognitive level of comprehen 
sion. The pretest and posttest levels of achievement of 70 and 72 
percent, respectively, for the experimental group are entirely satis- 
factory. It appears that the EMH students in our sample are retaining 
information they have learned. 



Objective Achievement Tests 



D escriptive Data and Interpretation . Pretests were administered 
to experimental classes between February 2 and March 31, 1971 and to 
control classes between February 10 and March 15, 1971. A continued 
difference in the amount of time devoted to science instruction resulted 
again in widely spread posttest administration dates for the experi- 
mental group. The earliest was March 8 and the latest May 5, 1971. 
Control group posttests were administered between March 19 and May 20, 
1971. 

Raw score frequency distributions on the tests for both experi- 
mental and control classes are shown in Table 213. Tables 214 and 215 
provide more detailed descriptive data on pretest and posttest scores 
and on residual gain scores, calculated with the raw regression coef- 
ficient for the combined experimental and control classes. The 
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interpretations that follow are based on the data provided in these 
tables* 

Table 213, Frequency Distribution of Raw Scores for 
Test Forms A and Experimental and Control Groups ^ Unit III 





Experimental Groups 


Control Groups 


Raw 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


Scores 


A 


B 


B 


A 


A 


B 


B 


A 


24-25 




1 




1 










22-23 




5 


1 


5 


1 


7 




1 


20-21 


3 


14 


5 


8 


2 


5 




3 


18-19 


11 


23 


13 


19 


8 


18 


5 


6 


16-17 


13 


14 


15 


20 


18 


17 


12 


16 


14-15 


19 


10 


17 


14 


16 


10 


23 


16 


12-13 


12 


5 


16 


7 


17 


14 


11 


20 


10-11 


6 




12 


4 


11 


3 


14 


11 


8-9 


8 


4 


5 


2 


7 


4 


9 


6 


6-7 


5 


2 


1 


3 


4 


4 


4 


1 


4-5 


1 






1 




1 


2 


1 


2-3 












1 




1 


0-1 














1 




Totals 


78 


78 


85 


85 


84 


84 


82 


82 



1* Experimental classes using pretest Form A registered means 



above and below the range of the standard error of measurement; 
the mean of one experimental class using pretest Form B was 
below the standard error or measurement^ indicating different 
levels of student knowledge prior to instruction in Unit III, 
Because of this result, covariance analysis with pretest and 
posttest scores and/or analysis of variance using residual gain 
scores will be necessary for any comparisons of student achieve- 
ment among experimental classes • 
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2. Posttest means for Forms A and B were also outside the range of 
the standard error of measurement, but posttest reliabilities 
were above the minimum acceptable level of .70, Eleven of 16 
experim.-^'ital classes showed positive mean residual gain scores 
and those with negative means were not seriously low. A multiple 
stepwise regression was performed to deteimine the effects of the 
independent variables on posttest scores. Analysis of variance on 
residual gain scores was also performed to confiim the results of 
analysis of covariance. 

3. Means for control classes using both pretest forms were outside 
of the range of the standard error of measurement, indicating 
different levels of knowledge at the time of pretesting. 

4. Posttest means for control classes were outside the limits of 
the standard error of measurement for both Form A and Form B. 
Three control classes, 82, 84 and 88 all scored very high mean 
residual gain scores, indicating that instruction probably took 
place in these classes between pretesting and posttest ing. As 
was the case with Unit II, this result eliminates the possibility 
of using control classes to compute a test-retest reliability 

for Unit III. Also similar to Unit II and confirming our hypothesi 
of control group instruction, an examination of the control group 
test score frequency distribution (see Table 213) also indicates 
upward shifts. 

Multiple Stepwise Regression Analys j s 



Experimental Group , Unit III . To determine the effect of the 
independent variables on posttest scores, the following question was 
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investigated: "Is there > significant difference in the level of 
achievement on the posttest among students in EMH classes having dif- 
ferent background variables?" 

The following independent variables were used to test this question: 
sex, age, WISC Full Scale IQ, race, teachers' assessment of reading 
achievement, teachers' assessment of verbal participation, and pretest 
score. All scores from Form A and Form B were pooled and treated as 
the results from one test. 

The results for the posttest administered to the 163 students in 
the Unit III experimental group are summarized in Table 216. The F- 
level of race was not high enough to enter into the regression equation. 

Table 216. Results of Multiple Linear Regression Analysis , 
Experimental Group, Unit III . 



Independent Variable g. 



Sex 
Age 

WISC Total IQ 

Reading 

Achievement 

Verbal 

Participation 

Pretest 



-0.1895 
0.0031 
0.1079 
0.3487 

"0.0364 

0.5305 



se. 



F 



.4720 
.0151 
.0308 
.1881 

.1964 

.0753 



0.1612 
0.0418 
12.2815** 
3.4356 

0.0343 

59.3864** 



**Significant at the .001 level, F = 10.83 

The F-value for each independent variable determines the level at 
which that variable is a significant predictor of a score on the post- 
test instriamenc. 

Discussion 

The data indicate that sex, age, race, teachers' assessment of 
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reading achievement and teachers' assessment of verbal participation 
are not significant predictors of success on the posttest. WISC Total 
IQ and the pretest score are very high predictors of success on the 
posttest (P<.001), These results are essentially tne same as those 
obtained for the previous units, except that IQ and pretest scores are 
the only significant predictors for Unit III. An analysis of variance 
was computed to determine the exact relationship between IQ scores and 
success on the posttest. 

Table 217. Matrix of Correlation Coefficients 
Experimental Groups Unit III 





Age 


Total 
IQ 


Race 


Reading 
Achieve- 
ment 


Verbal 
Partici- 
pation 


Pre- 
test 


Post- 
test 


Sex 


-.108 


-.156 


-.039 


.082 


-.045 


-.271 


-.199 


Age 




-.065 


-.212 


.286 


.080 


.364 


.231 


Total IQ 






-.059 


.270 


.287 


.482 


.534 


Race 








-.093 


-.195 


-.096 


-.076 


Reading 
Ach:.e /e- 
ment 










.388 


.201 


.290 


Verbal 
Partici- 
pation 












.198 


.213 


Pretest 














.692 



The effect of the pretest accounts for approximately 47.9 percent 
of the variance in the regression equation, which is higher than either 
Unit I or Unit II. The combination of pretest and WISC Total IQ account 
for 53.1 percent of the variance, which is also an improvement over 
Units I and II. The inclusion of all of the variables except race 
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accounts for 54.4 percent of the variance in the regression equation, 
as contrasted with 45.8 percent for Unit II and 53.5 percent for 
Unit I. 



Table 218. Multiple Stepwise Regression Analysis 
Experimental Group, Unit II 



Step 

Num- Variable 
ber Entered 



1 
2 



4 

5 



Pretest 

Total IQ 

Reading 
Achieve- 
ment 

Sex 

Age 

Verbal Par- 
ticipation 



Multiple 



.6924 
• 7289 

.7372 

,7375 
.7376 
.7377 



.4794 
.5314 

.5434 

.5439 
.5441 
.5442 



Increase 
2 

in r 



.4794 
.0519 

.0121 

.0005 
.0001 
.0001 



No. of 
F-Value Independent 
to Remove Variables 



148.2794 
17.7249 

4.2085 

.1709 
.0444 
.0343 



1 
2 



4 
5 
6 



Objective Achievement Tests 



Analyses of Variance and Covariance , Experimental Group , Unit ill . 
Two different statistical analyses were performed to investigate the 
question, "Is there a significant difference between experimental classes 
in the level of achievement on the Unit III post:est?" The results of an 
analysis of covariance are summarized in Table 219. These results 



Table 219. Analysis of Covariance Between Classes 
on Adjusted Unit III Posttest Means^ Pretest as Covariate 



Source 


d.f . 


Mean Square 


F-Ratio 


Between Groups 


15 


11.2801 


1. ;899 


Within Groups 


146 


7.5710 





No significant difference, F = 1.67 

.05(15,146) 
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indicate that there are no significant differences between experimental 
classes on posttest means adjusted for differences in pretest scores. 

Table 220 summarizes the means and standard deviations for 
pretests and posttests for each class in the experimental group. 



Table 220. 


N, 


Means, Standard 


Deviations, 


and Adjusted Means 


of 16 Classes 






Experimental Group, 


Unit III 










Posttest 


Adj us ted 








Posttest 


Standard 


Posttest 


Pretest 


Number 


N 


Mean 


Deviations 


Mean 


Mean 


21 




14.80 


3.77 


ID . d2 


13.20 


22 


1 n 


lb • 4U 


3 .95 


IT Q A 

1 / . o4 


12 .20 




1 1 
XX 


17.73 


3.44 


18 . 19 


13.55 


24 


9 


14.11 


4.34 


17.38 


9.67 


25 


10 


18.10 


1.45 


17.51 


15,00 


26 


14 


20.43 


1.65 


17.83 


17*79 


27 


11 


15.55 


4.61 


17.13 


12.00 


28 


8 


17.00 


2.78 


16.05 


15.50 


31 


8 


17.38 


3.54 


16.16 


15.88 


32 


11 


13.64 


4.78 


15.09 


12.18 


33 


12 


16.42 


4.08 


15.77 


15.08 


34 


11 


17.00 


3.00 


15.82 


15.82 


35 


10 


13.80 


3.91 


14.80 


12.80 


36 


11 


18.36 


3.26 


17.06 


16.00 


37 


14 


15.71 


3.75 


16.11 


13.64 


38 


8 


17.75 


3.37 


16.89 


15.38 



An 2uialysis of variance on residual gain scores was performed 
to confirm the results of the analysis of covariajice. The residual 
gain score used in this cinalysis was computed using the within-class 
pooled regression coefficient of experimental classes only. The 
results of the cinalysis of varicince, indicating no significant differ- 
ence between classes, are summarized in Table 221. This result 
confirms the results of the analysis of covaricince. 
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Table 22 1 > Analysis of Variance Between Classes on Residual Gain Scores 

Experimental Group ^ Unit III 



i50urce d.f. Mean Square F-Ratio 



Between Groups 15 11.3154 1.5048 

Within Groups 147 7.5194 



Kg significant difference, F ^^^^^ ^^^^ = 1.67 



Table 222 summarizes the means and standard deviations for 
residual gain scores for each class xn the experimental group. 
Table 222. Resi dual Gain, Class Data, Experimental Group, Unit III 



Class 






Standard 


Standard 








Number 


K 


Mean 


Deviation 


Error 


MaximuiTi 


Minimum 


Range 


21 


5 


-1.06 


2.23 


1 . CO 


1.60 


-3.16 


4,76 


22 


10 


1.27 


3.33 


1 .05 


6.90 


-3.43 


10.33 


23 


11 


1.62 


2.72 


0.S2 


5.18 


"3.82 


9.00 


24 


9 


0.81 


3.38 


1.13 


4.62 


"4.65 


9.27 


25 


10 


0.94 


1.29 


C.41 


3.18 


"1.05 


4.23 


26 


14 


1.26 


1.71 


0.46 


5.84 


-0.68 


6.72 


27 


11 


0.56 


3.53 


1.06 


3.73 


-3.93 


7.66 


28 


8 


-0.52 


1.88 


0.66 


1.57 


"3.16 


4.73 


31 


8 


-0.41 


2.29 


0.81 


3.12 


-4.43 


7.55 


32 


11 


"1.48 


3.88 


1.17 


3.01 


"8.71 


11.72 


33 


12 


-0.80 


2.96 


0.S5 


3.90 


"6.27 


10.17 


34 


11 


"0.75 


1.65 


0.50 


1.84 


"3.27 


5.11 


35 


10 


-1.77 


3.32 


1.05 


3.29 


-6.99 


10.28 


36 


11 


0.48 


2.84 


0.86 


4.57 


-6.05 


10.62 


37 


14 


-0.46 


2.75 


0.73 


3.12 


-7.54 


10.66 


38 


8 


0.32 


2.01 


0.71 


2.73 


-3.05 


5.78 



Discussion 



Teachers adhered more strictly to teaching strategies in Unit III 
than in Unit II and once again, as was the case with Unit I, no signifi- 
cant differences were found between classes, in view of these results. 
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it seems very important that teachers using the revised edition of 
ME NOW be given some kind of pre-service or in-service training to 
familiarize them with the philosophy and rationale of the program. 

One-Way Analysis of Variance Experimental Group , Unit III . The 
results of the multiple linear regression on the posttest indicated 
that Wise Total IQ was a significant predictor of succei^s on the 
posttest. To further investigate this result and to minimize the 
effect of the regression to the posttest mean, the following question 
was investigated: "Is there a significant difference in residual gain 
scores between students blocked on 3 levels of WISC Full Scale IQ 
scores?" 

Residua, ain scores for 163 students with WISC Full Scale IQ 
data were blocked on three different levels of IQ scores: 66 and less, 
67 to 79/ and 80 and above. An analysis of variance was performed on 
the residual gain scores in this one-way ANOVA design. Table 223 
sxjmmarizes the results of the analysis of variance, indicating that 
there is a significant difference between students in the three IQ 
levels. 

Table 223. ANOVA, Residual Gain Blocked on WISC Full Scale IQ 
Experimental Group, Unit III 



ERLC 



Source d.f. Mean Square F- Ratio 

Between Groups 2 52.4699 7.1744** 

Within Groups 160 7.3134 

**Significant at .001 level, F ,^ = 6.91 ^' 

.001(2,160) 

Table 224 summarizes the means and standard deviations for each 
of the three cells in the model. 
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Table 224, Cell Means and Standard Deviations 
Blocked Data, Unit III 



IQ Level n Mean 



Standard 
Deviation 



29 0.99 1.86 



67-79 99 0.28 



2.59 



1^^ 35 -1.40 3.49 



Discussion 

The results of the analysis of variance indicate that there is a 
significant difference between students whose IQ scores are above 66 
and those whose IQ scores are 66 and below (P<.001). This result 
indicates that the students for whom the materials were designed, 
those whose IQ scores are between 65 and 80, are experiencing success 
with the use of ME NOW. Similar to the results on previous units, 
students in the low IQ group (<66) do not perform as well as those 
students with higher IQ scores • One different result in Unit ill 
testing was that those students with IQ scores between 67 and 79 did 
not attain higher residual gain scores than students whose IQ scores 
were 80 and above. The need for suggestions to the teacher on how to 
use ME NOW for students whose IQ is below 66 is further emphasized by 
the results from Unit III. 

Experimental- Control Group Analyses . To investigate the question, 
"Is there a significant difference in student achievement between the 
experimental and control groups?" residual gain scores were computed 
using the raw regression coefficient, obtained by pooling all experi- 
mental and control students, and an analysis of variance was performed. 
Table 225 summarizes the mean residual gain scores and standard 



ERIC deviations for both groups 
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Table 225. Residual Gain Means and Standard Deviations 
Experimental and Control Groups ^ Unit III 



Group 


N 


Mean 


Standard 








Deviation 


Experimental 


163 


0.65 


2.81 


Control 


166 


-0.64 


3.08 



Table 226 summarizes the results of the analysis of variance, 
indicating a significant difference between the experimental and 
control groups (P<.001). 

Table 226. ANOVA, Experimental and Control 
Residual Cain Scores, Unit III 



Source 


d.f. 


Mean Square 


F"Ratio 


Between Groups 


1 


137.6530 


15.8526** 


Within Groups 


327 


8.6833 





* "Significant at the .001 level, F -^^^ = 10.83 



Discussion 

The results of the analysis of varicince indicate that there is a 
significant difference between the experimental and control groups on 
residual gain scores (P<.001). On the basis of these results, we 
concluded that the experimental Unit III materials did have an effect 
on EMH students, as assessed by the objective tests. Twenty- four of 
the 25 items on both forms assessed achievement on major objectives in 
Unit III; one pair of items measured recall from Unit I. Seven of the 
24 Unit III items were judged to provide baseline information, and 
17 were considered to be good indicators of student growth from pretest 
to posttest. 
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Factor Analysis > To determine the structure of the Unit III 
achievement tests, a Harris-Kaiser oblique, unnormalized, orthogonal 
rotation was performed on the results of posttests, A and B. For 
posttest A, 15 factors were identified which accounted for 47 percent 
of the variance. For posttest B, 16 factors were identified which 
accounted for 47 percent of the variance. 

Table 227 presents the results for posttest A, showing only those 
factors with eigenvalues above 1. The objective measured and cognitive 
level Df each item is included, as is a hypothetical name for each 
factor. The cognitive levels identified are the same as those used 
in the previous units. 

Table 227. Factor Structure - Unit III, Posttest A 



Factor 


Items 


Cognitive 
Level 


Objective 


Name 


1 


5 


high 


303 


balance - visual 




13 


low 


300 


interpretation 




18 


high 


303 




2 


15 


high 


302 


coordination - balance 




20 


high 


300 




3 


1 


knowledge 


301 


sense - protection 




22 


low 


300 




4 


11 


high 


300 


muscle action 




17 


knowledge 


302 





Table 228 presents the results of posttest B, showing only those 
factors with eigenvalues above 1. 

For Unit III, item pair 22-A, 19-B was the only pair identified 
in the factors with eigenvalues above 1. Many of the other paired 
items appeared in factors with eigenvalues below 1. items loading 
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Table 228* Factor Structure - Unit III, Posttest B 



Factor 


Items 


Cognitive 
Level 


Objective 


Name 


1 


7 


low 


302 


senses - protection 




12 


low 


301 






13 


knowledge 


302 






22 


low 


300 




2 


19 


low 


300 


protection 


3 


1 


knowledge 


301 


senses - heartbeat 




4 


knowledge 


301 






18 


low 


Unit I 





on the four factors of posttest A and the three factors of posttest 
B were well distributed across the test. There were more items dealing 
with the senses in posttest B factors (eigenvalues above 1) than in 
posttest A. 

Summary 

We can conclude that students in our sample learned from the ex- 
perimental Unit III materials. Experimental group achievement was 
satisfactory and significantly higher than control group achievement. 
Students whose IQ scores were higher than 66 scored significantly 
higher than students whose IQ scores were 66 or below on adjusted 
posttest scores. Both teadiGr feedback and achievement test items 
identified areas of instruction where modifications were necessary. 
Student interest and enthusiasm remained high throughout the unit. 



CHAPTER V 
EVALUATION OF UNIT IV 
GROWTH AND DEVELOPMENT 

The Instructional Program 

Instruction for 13 of the 16 experimental classes began from 
March 8 to May 14, 1971, Six of the 16 classes either did not use 
or did not complete Unit IV for various reasons. Three of these 
were unable to use the materials because of school board policies 
governing the study of human reproduction. The other three teachers 
did not have enough time left after completing Unit ill to complete 
Unit IV and administer posttests. Because of the sensitive nature of 
the topic of human reproduction, most control group teachers did not 
want to administer the pretests and posttests unless some instruction 
could be given, which would eliminate using these classes as a control. 
Because of these difficulties, the decision was made not to use a 
control group for Unit IV. 

The growth and development of a human being frcxn the moment of 
conception through old age is the focus of Unit IV. It provides a 
focal point for integrating and synthesizing the dynamics of the 
entire life cycle. Instruction begins with a discussion on recogni- 
tion of males and females, which leads into primary and secondary 
sex characteristics with the use of slides and posters. Stages of 
development from infancy to maturity are investigated using slides, 
which leads to a study of different rates of development within age 
groups. It is hoped that these differential rates of development 
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will be understood by the emh student to eliminate undue concern for 
the slowly developing child. 

Eggs from different aniiaals, includin^r humans, are studied ^ith 
the use of slides and worksheets. This leads into a study of female 
sex organs during adolescence. Ovulation and menstruation are studied 
and illustrated using an artificial model of female sex organs. The 
role of male sex organs during adolescence is the next topic followed 
by a discussion, with the aid of slides, of peer group attitudes and 
"proper" male and female behavior. The role of parents is investi- 
gated in a study about a family of geese. How an egg becomes fertilized 
by sperm from the male is studied with the aid of slides, worksheets 
and magnifying glasses. Development of the fetus within the mother is 
followed, again with the aid of slides, from conception through birth. 
Prenatal care is stressed, as is the proper care of infants. 

The above topics lead into a discussion of factors needed for 
growth and developnent and the students construct charts of theii 
growth in height and weight from birth to the present time. Heredity 
is introduced through the study of the students' and parents' height. 
Characteristics of people at different ages are investigated, and the 
unit terminates with a study of traits inherited from parents. 

Effectiveness of Instruction ; 
Data , Analysis , and Interpretation 

Objective 400 . Students wiul associate sexual distinction with 
bodv parts and characteristics > Three student activities and other 
instructional strategies were designed to develop student competencies 
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to achieve this objective. The writers assumed that the students had 
little or no knowledge of the subject matter prior to instruction. 

For activities 1 to 3, 69 percent of the teachers reported that 
they used the strategies as described; 31 percent reported some modi- 
fication. All teachers indicated that the strategies were successful. 

Teache.TS were unanimous in stating that most children were slightly 
embarrassed when the slide of the nude child was shown and that the 
embarrassment soon passed and fruitful discussions ensued. A typical 
comment was, "After the first explosion of giggles I told them that. I 
knew that they were embarrassed but after a few days they would be 
used to using the words for body parts and seeing the pictures: When 
I asked them if they were interested in studying this subject, they 
were most interested." 

Several teachers mentioned that students noticed the wider hips 
of the developed girls: "They noticed the wider hips of the older 
girls (in the pictures) as compared to the boys. 3102 offered the 
information that it was 'nature's' way of making women different so 
x:.iat there would be more room for a baby to grow inside the mother." 
This was then included in the revised materials. 

Another typical comment from activity 2 was, "Most kids when 
they started wanted to use height and size of overall body to dis- 
tinguish age. Hapiily as the lessons progressed thf kids used other 
means such a pubic and breast development as a basis of age. They were 
further amazed to find out that at the same age there were different 
stages of development." 

Figure 110 shows that teachers found student reactions to be 
extremely high across the three rating scales. All three activities 
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were judged to be very important (see Figure 111) 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingress 



100 

Percent of 
teachers 50 

{N=13)-^^ 




high 

neutral 

low 



543215432154321 
Figure 110. Reaction of the majority of students .o activities 1 to 3 



100 



Percent 50 - 




I 



Percent of 
teachers 
(N=13) 



5 4 3 2 1 
Important OK Useless 



Figure 111. Iitportance to students of activities 1 to 3 
Figure 112 shows the proportion of students in the class who were 
able to perfonri the behaviors specified by the five subc±)jectives. 



100 



50 




I 



100 



50 



All 3 1 1 .1 None 
4 2 4 4 



Percent of 
teachers 
(N=12) 




Figure 112. Proportion of 
students able to perform 
on subobjectives of 
objective 101 



5 4 3 2 1 

Important ■ OK > Useless 

Figure 113. Importance of the 
subobjectives 



19 



The total number of teachers reporting in Unit IV is 13, although 
complete pretest and posttest data were obtained for only 10 teachers. 
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Eighty-six percent of the teachers reported that three-fourths or more 
of their students could successfully perform the desired behaviors. 
Teachers considered the subobjectives to be important also (see Figure 
113) . 

Two item pairs were designed to assess achievement on this 
objective, since no control group was used in Unit IV, only experi- 
mental group item data will be presented. 

WHICH OF THfSE IS FOUND IN fWLES ONLY' 8< 
Hari^ an X ON tm£ word ycu choose. 



W-^ICH OF THESE IS F0U!;B \U FEIALES CNLY' 

'*fiR^ AH X ON The »»0RD yCU CmCOSE. 



12b 



s] [chest] |voia| 



OVARY 



|£peast| |voiie| I testicles 



Item pair 8-A, 12-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest for the experimental group was 
24 percent (from 39 to 63 percent) . This gain is excellent and 
certainly attributable to the effect of instruction. Staff visits to 
classrooms at this time indicated a slight embarrassment on the part of 
some teachers to discuss male and female sex organs with their students 
during the early lessons. This effect gradually disappeared from the 
teachers as well as from the students, but we feel that the posttest 
achievement level would have been higher if teachers had begun using 
proper suggested terminology at the proper time. The biserial correla- 
tions are excellent, especially the .94 for posttest B. 

Table 229. item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


8-A 
12-B 


47 

59 


40 28 17 15 0 0 
39 10 39 12 0 0 


59 
47 


64 5 3 27 0 0 
62^ 11 9 19 0 0 


.34 
.23 


.37 
.94 
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Table 230. Pretest to Posttest Changes 
(The response choice for 8-A is cited first) 



Item Pair 8-A, 12-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A A A+A 


B D B+D* 


C B C+B 


D C D+C 


Experi- 
mental 


+22 +23 +24 


-23 +7 -8 


-14 +1 -6 


+12 -30 -9 



*B on Form A and D on Form B are not parallel distractors. 



WHICH Of THESE CAN BEST TELL YOi; IF THIS PERSW IS A BOY CP GIPL 
HriAT THE P£RSON IS DOING. THE Pr PSON'S BODY PARTS THE PERSON'S 

{•mip style, what The PE?sof< :s we«riw;'> 



WHICH OF THESE C« BcST TELL YO(j IF THIS PeRSOH IS A BOY OR 
GIRL m\ THE PERSON IS OOIHG, THE PERSON'S BODY PARTS. 
THE PERSON'S HAiR STYLE,, ml THE PERSON IS HEARIHG? 





Iapk an X ON youR choice, 



what the ^>ersdn 

IS D0IW3 




THE PERSON'S 
BODY PARTS 




THE flRSON'S 
HAIR STYLE 




WHAT THE PERSON 
IS WEARING 


A 


h 


c 







ChOILE. 






L'h;i The person 

1 I J DOING 




THE PERSOirS 
BODY PARTS 




THE PERSON'S 
HAIR STYLE 




WHAT THE PERSON 
IS WEARING 


A 




t 


c 





Item pair 9-A, 4-B functions at the cognitive level of knowledge. 

Mean net gain from pretest to posttest \vas 16 percent (from 32 to 48 

percent). Again, these gains are excellent, but probably would have 

been greater if teachers had commenced to use the proper terminology 

at the onset of instruction. This gain is attributed to the effect 

of instruction and can be accounted for by losses on all response 

choices except "what the person is doing/' which has a mean total gain 

Table 231. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of U 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


9-A 
4-B 


47 

59 


6 23 30 40 0 0 
2 39 32 27 0 0 


59 
47 


2 51 24 24 0 0 
9 45 21 26 0 0 


.40 
.50 


• 30 
.66 



Table 232. Pretest to Posttest Changes 
(The response choice for 9-A is cited first.) 



Item Pair 4-B 


Percent Change, Pretest to 


Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor 


Pairs 


B B B+B 


A A A+A 


C C C+C 


D D D+D 


Experi- 
mental 


+28 +6 +16 


-4 +7 +1 


-6 -11 ^8 


-16 -1 -8 



of one percent. Proper behavioral roles for males and females was 
emphasized and probably played a part in this result. Biserial correla- 
tions indicate that both items are good discriminators. 



Objective 401 . Students will identify and distinguish functional 
roles of organs related to sex. Four student activities and other 
instructional strategies were designed to develop student competencies 
to achieve this objective. 

For activities 4 to 7, 67 percent of the teachers reported that 
they used the strategies as described; 33 percent reported sme modifi- 
cation. Some changes initiated by the teachers worked out very well: 
"For activity 5 I made a model using a plastic shampoo bottle for the 
uterus, etc. I used a flower seed instead of a bead and put about 3 
drops of Elmer's glue in the oviduct to plant the 'egg' down the oviduct 
to tne uterus and red coioiad water to wash the egg through the uterus 
and vagina. This was very effective. The plastic bottle that I used 
for the utorus had a neck about 4 inches long — so I used three 
Tampax ~ one at a time to show the children the 'process* of 
menstruation and the means used by girls to care for this function. 
The school nurse supplied me with a kit and we also demonstrated the 
use of sanitary pads. We repeated the demonstration several times so 
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that the children could actually see the egg pass through and out of the 
'organs' 

Some, minor problems were encountered in activity 7 with the schematic 
diagram of the male reproductive system. The schematic diagram shows the 
testes above the penis and students were confusing the testes with the 
kidneys. Thus, in the revised materials, the urinary system was removed 
and tubes should be drawn from the testes to the penis. 



100 

Percent of 
teachers 50 
(N=13) 
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543215432154321 
Figure 114. Reaction of the majority of students to activities 4 to 7 

Figure 114 shows that teachers found student .eactions very high 
across the three rating scales. The average importance ratings across 
the four activities were also very high (see Figure 115) . 



100 



Percent 50 




I 



Percent of 
teachers 
(N=12) 



5 4 3 2 1 
Important * OK ■ Useless 



Figure 115. Importance to students of activities 4 to 7 
Teachers reported a moderately high proportion of students 
experiencing success on the eight subobjectives of objective 401. 
Seventy-two percent of the teachers reported that three-fourths or 
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more of their students were successful. Figure 117 shows that teachers 
rated the subobjectives as being very important for EMH students. 

100 



50 



47 



25 I 24 

liUL 



I 



100 



50 



Percent of 
teachers 
(N=12) 




All 1 i i A None 
4 2 4 4 



Figure 116. Proportion of 
students able to perform 
on subobjectives of 
objective 401 



5 4 3 2 1 
Important ^ OK <^ Useless 

Figure 117* Importance of the 
subobjectives 



Five item pairs were designed to assess student achievement on 
objective 401. 

WHICH OF THESE COMES FROT. FEMALES ONLY- SPEPfl, SE^EN, UPINE. EGGS^ 3a hHICH OF THfSE MS MALES mU. EGGS. URINE. MILK. SPERM'' 



Mark an X on the woao you choose. 
I SPERM I |SE«£N| hmil 



I EGGS I 



MAR^ AN )( ON THE WORD YOU CHOOSE. 

ITggsI luPiNt i IkilkI I 



SPERfl 



Item pair 3-A, 7-B functions at the cognitive level of knowledge. 

Mean net gain from pretest to posttest was 35 percent (from 44 to 79 

percent) . This is considered an excellent gain attributable to the 

effect of instruction. Marked shifts occurred from all other item 

pairs from the pretest to posttest. Actually, pretest responses were 

very nearly random in pattern. Biserial correlations are excellent. 

Table 233. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 






Percent of N 


N 


Percent of N 


A B C D M n 


A B C D M n 




Post , 


Experi- 
mental 


3-A 
7-B 


47 
59 


28 19 21 32 0 0 
5 22 19 54 0 0 


59 
47 


7 0 3 90 0 0 
26 4 4 66 0 0 


.43 
.56 


.80 
.53 
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Table 234. Pretest to Posttest Changes 
(The response choice for 3-A is cited first) 



Item Pair 7~B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D D D+D 


A A A+A 


C B CrB 


B C B+C 


Ejcperi- 
mental 


+58 +12 +35 


-21 +21 0 


-16 -18 -19 


-19 -15 -17 



KHICH Of THE F0LL0NIN6 PRODUCE EG6S^ 
Hark an X oh th£ picture you choose, 




mCHfW THE FOLLOW I NG PRODUCE SPERM' 
Hark an X on the picture rou choosC. 



19b 




Item pair 5-A, 19-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest was 37 percent (from 51 to 
88 percent) , which is considered excellent and is attributed to the 
effect of instruction. Very marked shifts occurred from all other 
response choices from pretest, where responses were very nearly random, 
to posttest. Biserial correlations are exceptionally high. It is 
apparent that before instruction many more students were familiar with 
the fact that males produced sperm than with the fact that human females 

Table 235. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


5-A 
19-B 


47 

59 


38 3£ 15 6 2 0 
24 3 12 0 0 


59 
47 


0 97 2 2 0 0 
15 2 77 4 2 0 


.49 
.44 


.75 
.78 
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Table 236. Pretest to Posttest Changes 
(The response choice for 5-A is cited first) . 



Item Pair 5-A, 19-B 


Percent Change, Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Dis tractor 


Pairs 




B C B+C 


A B A+B* 


C B C+D* 


D A 


D+A 


Experi- 
mental 


+59 +16 +37 


-38 -1 -18 


-13 -8 -10 


-4 -9 


-8 



*A and C on Form A, and B and D on Form B are not parallel distractors. 
produced eggs. The 97 percent posttest achievement level for Form A 



indicates that knowledge of female egg production is very near the 
mastery level. 

MENSTRUATIOfi IS EMBARRASS INC., SHAMEFUL., HAW1FUL. NORfWL'. 15* HENSTPUATION IS SHAMEFUL., NORflAL.. HARMFUL., EMBARRASS I N6^ 188 

Mask an X on your choice. 

I EMBARRASSING I | SHAMEFUL) | HARMFUL | | NORMAL | ^ 

* 8 c 1; I SHAMEFUL | | NORMAL | | HARMFUL | [li"ARRA$SING| 

A fc C D 

Item pair 13-A, 18-B is really a measure of student attitude. 
However, because we were striving to attain a shift from pretest to 
posttest for the response, "natural," we believe that students should 
receive credit for the desired response and the score for this item 
pair is included in the total score for both forms. Mean net gain 
from pretest to posttest was 24 percent (from 40 to 64 percent) , which 
we consider to be excellent, if time were not such a factor near the 
closing of the school year, more instruction time could have resulted in 
a more significant shift in posttest responses. Biserial correlations are 
very good, although not entirely appropriate for an attitude question. 



Table 237. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


13-A 
18-B 


47 

59 


26 23 13 38 0 0 
12 41 19 27 2 0 


59 
47 


15 8 12 61 3 0 
6 68 17 6 2 0 


.60 
.50 


.67 
.50 
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Table 238. Pretest to Posttest Changes 
(The response choice for 13-A is cited first) 



Item Pair 13-A, 18-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D B D+B 


A D A+D 


B A B+A 


C C C+C 


Experi- 
mental 


+23 +27 +24 


-11 -21 -16 


-15 -6 -10 


-21 -2 -11 



KLili UVAKT, Ttb lut UVAPY, PENIS - liTEPJS? TESTICIE • VAGINA., SPERPI - VAGINA., SPERN -EGG? 



Hark an X on cHciCt 



AN X ON yOUB choice. 



TESTICLE 
UTERUS 



PENIS 
OVA?Y 



TESTICLE 
OVAfy 



PEHIS 
UTERUS 



TESTICLE 
£66 



TESTICLE 
VAGINA 



SPERfl 
VAGINA 



SPERM 
EGG 



Item pair 14-A/ 9-B functions at the cognitive level of analysis. 
There was a mean net loss of four percent (from 36 to 32 percent) from 
pretest to posttest on this item pair. Poth pretest and posttest 
response patterns were random. It is clear that the process of equating 
functions of two analogous organs is too complex for EMH students at 
this level. We recommend, however, that the item pair remain in the 
test for use by teachers during instruction to see if any students are 
capable of performing this complex task. Testing with this item should 
be on a one-to-one basis so the teacher can ask the student why a particu- 
lar response was chosen. This is the only way to determine whether or 
not the student is guessing. 

Table 239. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


14-A 
9-B 


47 
59 


17 17 26 40 0 0 
10 8 37 44 0 0 


59 
47 


3 22 24 51 0 0 
9 15 34 43 0 0 


.02 
.40 


.31 
.44 
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Table 240 • Pretest to Posttest Changes 
(The response choice for 14-A is cited first) . 



Item Pa. 


Lr 14-A, 9-B 


Percent Change, Pretest to 


Posttesc 




Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C D C+D 


A A A+A 


B B B+B 


D C 


D+C 


Experi- 
mental 


-2 -1 -.4 


-14 -1 -7 


+5 +7 +7 


+11 -3 


+5 
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MASTURBATION IS DESTRUCTIVE.. SHAMEFUL., HARMFUL., NATURAL^ 17a ^ASTURPATION riATURAL, SH/IIEFUL. HARflFUL. D£3TPitt;v[^ 

Hark an X oh your choice. X ^^^^^^^ 

[w^liin { HARMFUL I rsSSfFn l destructive t 

A BCD ' ' * ' ^ ' - ' 



Item pair 17-A, 14-B was designed to measure changes in student 

attitude before and after instruction. This item pair is treated 

similar to 13-A, 18-B, that is, we are looking for a shift to the 

response, "natural," and this response is being scored and added to 

the total test score. Mean net gain from pretest to posttest was 29 

percent (from 39 to 68 percent), which we attribute to the effect of 

instruction. There were losses on all other response choices. 

Table 241. item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


W 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


17-A 
14-B 


47 

59 


23 19 21 36 0 0 
41 20 25 14 0 0 


59 
47 


14 12 15 59_ 0 0 
79^ 2 6 13 0 0 


.62 
.32 


.62 
.78 



Table 242. Pretest to Posttest Changes 
(The response choice for 17-A is cited first) 



Item Pa. 


Lr 17-A, 14-B 


Percent Change, Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D A D+A 


A D A+D 


B B B+B 


C c 


C+C 


Experi- 
mental 


+23 +38 +29 


-9 -1 -4 


-7 -18 -12 


-6 -19 


-12 
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Biserial correlations are exceptionally high, although not entirely 
appropriate for attitude questions. 



Objective 402 , Students will infer social roles related to sex. 
Two student activities and other instructional strategies were designed 
to develop student canpetencies to achieve this objective. 

For activities 8 and 9, 92 percent of the teachers reported that 
they used the strategies as described; eight percent reported scwne 
modification. No problems were encountered in either activity 8 or 9. 
One teacher's comment was typical of most received: "Activity 9 
really turned the kids on. It was so good that the discussion could 
have been carried on almost forever, it was probably one of the best 
lessons for motivating my group." 

Interest Pleasure Willingness 

Disinterest Displeasiare Unwillingness 

100 



Percent of 
teachers 50 
(1^13) 




5 = high 
3 = neutral 
1 = low 



543215432154321 
Figure 118. Reaction of the majority of students to activities 8 and 9 

Figiare 118 shows that student reactions were very high across the 
three rating scales. Both activities were judged importa by the 
teachers, but the importance is not rated as high as student enthusiasm 
(see Figure 119) . 
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100 



Percent 50 




I 



5 4 3 2 1 
Important • OK » Useless 



Percent of 
teachers 
(N=13) 



Figure 119. Importance to students of activities 8 and 9 
Figure 120 shows the proportion of students who were able to success- 
fully perform the behaviors specified by the two subobjectives of 
objective 402. Ninety-two percent of the teachers reported that three- 
fourths or more of their students were successful. Figure 121 shows that 
teachers rated the subobjectives as very important. 



100 



50 - 




I 



Percent of 
teachers 
(N=13) 



100 



50 -, 



All 2 i 1 A None 
4 2 4 4 




Figure 120. Proportion of 
students able to perform 
on subobjectives of 
objective 402 



5 4 3 2 1 

Important OK Useless 

Figure 121. Importance of the 
subobjectives 



No test items were designed to assess student achievement on this 
item. However, teacher reports, as indicated by the above figures, 
show that student success was at an acceptable level. 



Objective 403. Students will associate parental roles with the 
formation and development of a new individual . Five student activities 
and other instructional strategies were designed to develop student 

ERIC 



^ competencies to achieve this objective. 
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For activity 10, which deals with human fertilization, 82 percent 
of the teachers reported using the strategies as described, nine percenc 
(one teacher) reported much modification- The teacher reporting much 
modification sent activities 10-15 home for the parents to teach; her 
feedback has been v-aluable and will continue to be used but we elimina- 
ted her class from the test analysis. No problems were encountered by 
the teachers in activity 10, only intense curiosity about sexual 
intercourse. 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N-11) 



100 



50 - 




5 = high 
3 = neutral 
1 = low 



543215432154321 
Figure 122. Reaction of the majority of students to activity 10 
Figure 122 indicates that teachers judged student reactions to be 
very high across the three rating scales. Figure '''^3 shows that 
teachers considered the activity to very important. 



100 



PercGnt 50 - 




I 



5 4 3 2 1 
Important OK Useless 



Percent of 
teachers 
(N=13) 



Figure 123. Importance to students of activity 10 
Figure 124 shows the proportion of students who were able to 
successfully perform the behaviors specified by the seven subobjectives 
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for activity 10. Eighty-four percent of the teachers reported that 
three-fourths or more of their students were successful. Figure 125 
shows the average teacher rating of importance over the seven 
subobjectives. 



100 



All 3 1 ]. _! None 
4 2 4 4 



100 



I 



Percent of 
teachers 
(N=ll) 



75 



50 -I 

0 llii 



Important 



4 3 2 1 
—OK Useless 



Figure 124. Proportion of 
students able to perform 
on subobjeccives of 
activity 10 



Figure 125. Importance of 
subobjectives 



For activities 11 and 12, 83 percent of the teachers reported 
using the strategies as described; 17 percent reported some modifi- 
cation. All teachers reported that the strategies were successful. 
Teacher comments were very positive on these activities. An example 
is: "There were many great questions that this activity brought about 
such as why multiple births, birth control, and why some women did not 
get pregnant, it was a challenge to answer but great fun. Also I think 
it shows that the kids know more than we thlrk. The lesson was really 
good and it made development vory ^Uiar. 1 was pleased to find that 
the kids figured out that blood goes through the umbilical cord because 
blood carried food all over chs body but the baby could not eat his own 
food so he had to use both mother's food and oxygen." 

Figure 126 shows that student reactions were verv high across 
the three rating scales, figure 127 shows the average teacher rating 
of importance for the two activities. 
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Interest Pleasure Willingness 

Disinterest Displeasura Unwillingness 



Percent of 
teachers 
(N=12) 



100 



50 - 




5 = high 
— 3 = neutral 
1 ■= low 



543215432154321 
Figu.. 126. Reaction of the majority of students to activities 11 and 12 
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Percent of 
teachers 
(N=12) 



5 4 3 2 1 
Important OK Useless 



Figure 127. Importance to students of activities 11 a. ] 12 
Figure 128 shows the proportion of students who could successfully 
perform the behaviors specified by rhe seven subobjectives of activities 
11 and 12. Ninety percent of the teachers reported that three-fourths 
or more of their students could perform the specified behaviors; 47 
percent reported that all of their students were successful. Figure 
129 shows the average teacher rating of the importance of the seven 
subobjectives. 



100 



50 



All 3 1 1 .1 None 
4 2 4 4 



I 



Percent of 
teachers 
(N=ll) 



100 



50 




Figure 128. Proportion of 
students able to perform 
on sijbobjectives of 
objective 403 



5 4 3 2 1 
Important * OK Useless 

Figure 129. Importance of the 
sxabobjectives 
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For activities 13 and 14, 67 percent of the teachers reported that 
they used the strategies as described; 33 percent reported scxtie modifi- 
cation. Ninety-two percent of the teachers reported that the strategies 
were successful. Many teachers reported student misconceptions con- 
cerning development of the unborn child and the actual birth process. 
One example is typical: "Most of the students thought the mother's 
'stomach' was cut open to deliver a baby. Once the idea of regular 
birth delivery was presented they seemed to have no difficulty at all 
in following ideas. The girls really worried about what would happen 
to their stomach." 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



Percent of 
teachers 
(N=12) 



loo 1— 



50 




5 = high 
3 = neutral 
1 = low 



543215432154321 
Figure 130. *veaction of the majority of students to activities 13 and 14 

Figure 130 shows tliat student reactions were again very high across 

the three rating scales. Figure 131 shows that teachers also rated the 

activities as being very important for EMH children. One teacher is 

still embarrassed by the material and tends to rate most activities 

100 



Percent 50 - 




I 



Percent of 
teachers 
(N=12) 



5 4 3 2 1 
Important ■ OK ■ Useless 



Figure 131. Iir^jortance to students of activities 13 and 14 
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dealing with reproductive organs or the reproductive process as 
unimportcint • 



100 




I 



100 



50 



Percent of 
teachers 
(N=ll) 



53 
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Figure 132. Proportion of 
students able to perform 
on subobjectives of 
activities 13 and 14 
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Important OK ■ UseJ jss 

Figure 133. Importance of the 
subobjectives 



Figure 132 shows that the success ratio averaged across the seven 
subobjectives of activities 13 and 14 was lower than for most previous 
activities. Those subobjectives where student success was low dealt 
mostly with determining the date of birth and date of conception by 
counting days on the calendar. These activities should be simplified 
and clarified in the revised materials. Several teachars noted that 
having children determine the date on which they were conceived could 
lead to problems or embarrassment for the child/ but the majority of 
teachers advised us to leave this in the activity and the discretion of 
the teacher would determine whether or not it was used. The importance 
of the subobjectives was generally quite high. The average ratings 
across the seven si?bobjectives are shown in Figure 133. The above 
problem led to a decreased rating by several teachers for several 
objectives. 

Eight item pairs were designed to measure student achievement on 
objective 403. 
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WHtPE DOES A BABY DEVELOP^ 

Mark am X in the circu oh the line ^^at tqocmES that papt 



WHtPE DOES A EABV ^€V£LOP^ 

•^A<^^ AS X IV th: c:rc.e uu the ..ine that tcuches that papt. 





Item pair 6-B functions at the cognitive level of comprehen- 

sion. Mean net gain from pretest to posttest was 35 percent (from 60 
to 95 percent) , which we feel is spectacular and most certainly attri- 
butable to the effect of instruction. The most notable shift from 
pretest to posttest was fron choosing the stomach as the location where 
the baby develops to choosing the uterus. The 95 percent posttest level 
approaches the level of mastery for this concept. 

Table 243. item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 


- — 


N 


Percent of M 


N 


Percent- nf ^ 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


4-A 
6-B 


47 
59 


0 45 55 0 0 0 
0 64 25 3 7 0 


39 
47 


0 3 95 2 0 0 
0 96 4 0 0 0 


.32 
.62 


.95 
.45 



Table 244. Pretest to Posttest Changes 
(The response choice for 4-A is cited first) . 



Item Pa 


ir 4-A, 6-B Percent Chanae. Pretest p^q^-^oqI- 


Student 
Group 


Correct 
Choice 


Parc^llel Distractor Pairs 


C B C+B 


A D A+D 


B C B+C 


D A DfA 


Experi- 
mental 


f40 +32 +35 


0 -3 -2 


-42 -21 -31 


+2 0 +1 
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BEFORE BIRTH WHERE DOeS fOOD.. OXYGEN.. AND WATER 
ESTER THE BABY' 

Mark an X in the circle on the line that touches that past. 



BEFORE BIRTH WHERE DO WASTES LEAVE THE BABY' 3b 

Ma«< an X IN Th£ CJRCLE on THE LINE THAT TOUCHES THAT ^ART. 





Item pair 3-B functions at the cognitive level of conprehen- 

sion. Mean net gain from pretest to posttest was 39 percent (from 37 to 
76 percent) . This excellent gain is attributed to the effect of instruc- 
tion and can be accounted for by losses on all other response choices. 
The most notable shift was fran choosing the anus and mouth or nose as 
the sites of entering essentials and exiting waste materials (which were 
studied in previous units) to choosing the umbilical cord on the posttest. 
Biserial correlations are unusually high. 

Table 245. item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Ea^eri- 
mental 


7-A 
3-B 


47 

59 


6 34 43 17 0 0 
47 39 5 8 0 0 


59 
47 


3 86 7 3 0 0 
26 64 0 6 4 0 


.53 
.53 


.64 
.84 



Table 246. Pretest to Posttest Changes 
(The response choice for 7-A is cited first) 



Item Pa: 


Lr 7-A, 3-B 


Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor 


Pairs 


B B B+B 


A A A+A 


C D C+D 


D C D+C 


Experi- 
n^ental 


+52 +25 +39 


"3 -21 -16 


-36 -2 -17 


-14 -5 -8 
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10* WHICH DRAWING SHOWS A FERTILIZED EGG'' 136 

fURK *N X OH YOyR Choice, 

Q ;o o o 

A ^ B c e 

Item pair 10-A, 13-B functions at the cognitive level of comprehen- 
sion. Mean net gain from pretest to posttest was 27 percent (from 31 to 
58 percent) . We attribute this excellent gain to the effect of instruc- 
tion. One possible problem on this item pair is that any of the eggs 
could already have been fertilized, except the one which is being ferti- 
lized (response choice C on Form A and D on Form B) • it is recommended 
that the stem of this item be changed to "Which egg is being fertilized," 
to eliminate a possible problem of interpretation. Biserial correlation 
levels are good, indicating that the item pair is discriminating between 
high and low-scoring students. 



Table 247. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


10-A 
13-B 


47 
59 


2 4 32 62 0 0 
10 8 49 31^ 2 0 


59 
47 


5 3 54 37 0 0 
2 9 28 62 0 0 


.47 
.47 


• 39 
.33 



Table 248. Pretest to Posttest Changes 
(The response choice for 10-A is cited first) . 



Item Pair 10-A, 13-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C D C+D 


A B A+B 


B A B+A 


D C D+C 


Experi- 
mental 


+22 +31 +27 


+ 3 -1 +2 


-1 -8 -4 


-25 -21 -22 



WHICH DRAWING SHOWS A fEPTlLlZEO EGG^ 

fURK AN X OH YOUR ChOJCE. 
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A i-ill^ WAS 30R'J IN APRIL. ABOUT WHEN DID THE ^THtP BECOME P^HAHV 11. A ^TOTHER BECAME PREGNAin IN JUNE. ABOUT WHEN WAS HER CHILD BORN? 5b 

N^^^^^pyl Ifmrny] pjARoTl [appITI [may] 

[jULy] i AUGUST I |S£PTEWEER| |OCT0£EP| {m^^ \dia^m\ 



JANUARY 



FEBRUARY 



MARCH 



APRIL 



AUGUS' 



T) I SEPTEMBER! |0CT0&Er| | NOVEMBER | | DECEMBER [ 



Marh; A% X ON The rCNTH VOU ChOOSE. 

|APRiL| I AUGUST I |fjOVEM£^R| [FEBRUAPyI 



Mar*, an X r% the «ionTm you cnca^E. 
[MD I SEPTEMBER I I DECEMBER I [mARCh] 



Item pair 5-B functions at the cognitive level of comprehension. 

Item 11-A was deleted from analysis because there was no correct choice 
(July) for the item. Because of this, no average gains were computed 
and only achievement levels and gains for item 5-B are shown- Mean gain 
from pretest to post test for 5-B was 40 percent (from 20 to 60 percent) , 
indicating that instruction did have an effect on posttest achievement. 
Biserial correlations are average. 

Table 249. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


11-A 
5-B 


47 

59 


deleted 
12 29 31 20 8 C 


47 


deleted 
4 15 9 60 13 0 


.46 


.37 



Table 250. Pretest to Posttest Changes 



Item Pair 11-A, 5-B Percent Chanae, Pretest to Pnct-t-oc^ 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


D 


A 


B 


C 


Experi - 
mental 


+40 


-8 


-14 


-22 
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BEFORE THEY ARE BORN BABIES GROW IN THEIR MOTHER'S. 
STO^CH, UTERUS. INTESTINE. ELADDEP^ 



BEFORE THEY ARE BORN BABIES GROW IN THfIR WTHER'S 
INTESTIME, BLADDER, STOMACH. UTERUS' 



•UftH AM X ON YOU« CHOICE. 




I STyWCH I I UTERUS [ [iNTESTirjE] 



I UTERUS 



Item pair 12-A, 16-B functions at the cognitive level of knowledge* 

Mean net gain from pretest to posttest was 52 percent (from 36 to 88 

percent) , a truly remarkable gain attributable to the effect of instruc-. 

tion* The most notable change, as was the case with item pair 

6-B was from choosing the stomach on the pretest to choosing the uterus 

on the posttest as the site where the unborn baby develops, Biserial 

correlations are exceptionally high. 

Table 251. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Croup 


Item 
# 




Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


12-A 
16-B 


47 

59 


57 17 11 15 0 0 
5 5 37 51 2 0 


59 
47 


5 8b 3 3 0 0 
2 4 4 89 0 0 


.66 
• 40 


.84 
.79 



Table 252. Pretest to Posttest Changes 
(The response choice for 12-'A is cited first) . 



Item Pair 12-A, 16-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B D B+D 


A C A+C 


_C A C+A 


D B D+B 


Experi- 
mental 


+ 71 +38 +52 


-52 -33 -41 


-8 -3 -5 


-12 -1 -6 
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mm WAS THE J*«bILICAL cord once ATTACHED'' 

an X \'i The circle Oh THi nui That touches That part. 



.5. wf: T- .^--ILICAL CPCD ONCi ATTACHED^ 

*'A^^ AN A 1\ T-^s ;iRCl.l CN TfE ^INg THAT TOUCrES ThAT PART. 




Item pair 15-A, 8-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest was 15 percent (from 
74 to 89 percent). This item pair is juriaed to provide baseline 
information, since 74 percent of the students in our sample knew that 
the umbilical cord was attached at the navel prior to instruction. 
With this high pretest level, the 15 percent gain is excellent and is 
attributed to the effect of instruction. Biserial correlations are 
exceptionally high. 

Table 253. iteir Responses and Biserial Correlations / 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


15-A 
8-B 


47 

59 


0 62 17 21 0 0 
0 14 83 3 0 0 


59 
47 


0 90 8 2 0 0 
0 13 82 0 0 0 


.63 
.45 


.86 
.81 



Tab^e 254. Pretest to Posttest Changes 
(The response choice for 15-A is cited first. 



Item Pa 


ir 15-A, 8-B 


Percent Change, Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B C B+C 


A D A+D 


C B C+B 


D A 


D+A 


Experi- 
mental 

i 


+28 +4 +15 


0 -3 -2 


-9 -1 -5 


-19 0 


-8 



WAT IS HISSING FROM THE DIAGRAM ABOVE' 
Mark an X on your choice. 



SPERM 




PENIS 




EGG TUBE 




1 sperm) 


B 


c 




A 


E 



WHAT IS «ISSI«G rm THE DIAGRAd ABOVE? 

Iark an X on vcjf CHOICE. 

PENIS I 



EGG TUBE I 



Item pair 16-A, 11-B functions at the cognitive level of analysis. 
Mean net gain from pretest to posttest was 41 percent (from 15 to 56 
percent) , which is exceptionally high and attributable to the effect 
of instruction. This item d" mstrates clearly that many EMH students 
can handle problems involving high level cognitive processes involving 
one variable. The comparison of two variables at this same cognitive 
level was not successful (see item pair 14-A, 9-B, objective 401) . 
Biserial correlations indicate that both items are good discriminators. 

Table 255. item Respor-es and Biserial Correlations 
for Ejtperimtntal Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


16-A 
11-B 


47 
59 


17 15 34 28 6 0 
15 24 34 25 2 0 


59 
47 


7 58 8 24 3 0 
52 9 15 23 0 0 


• 62 
.57 


.52 
.42 



Table 256. Pretest to Posttest Changes 
(The response choice for 16-A is cited first. 



Item Pa. 


Lr 16-A, 11-B 


Percent Change* Pretest to 






Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


B A B+A 


A B A+B 


c c c+c 


D D 


D+D 


Experi- 
mental 


+43 +38 +41 


-10 -15 -13 


-26 -10 -23 


-4 -2 


-2 
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l^^ AN 1% !S FLPHLiZED. TriE H'^m CA'i EX^LCT TO hAvE 
sAHY., sEC01£ ill, -^A/E a rEr.TRdAL ^EPIOj., LOSE A BA3Y' 

lARfc AN < ON fOU^ CHf^ICE. 



18a 



iP AN EGG IS •♦CT FERTILIZED. TrE FEMLE 'CAN EXPECT TO HAVE i'h 
A -APV. prroME ILL. mAVE A ^ETTfuAL f'tRIO: LOSE A ?A3Y'^ 



HAVE A 
BABY 

A 




a. 




h:vE a menstrual 
PERIOD 




LOSE A 
5ASY 




. AVE A 
i^ABY 




cECO^ 
ILL 




"AVE A •MENSTRUAL 
PERIOD 




LOSE A 
BABY 



Item pair 18-A, 15-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest was 30 percent (from 33 to 63 
percent) . This very good gain is attributed to the effect of instruc- 
tion. If more time could have been spent on instruction in Unit IV 
we feel that the posttest achievement level would have been higher. 
Biserial correlations are excellent. 

Table 257. item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


18-A 
15-B 


47 
59 


49 9 13 30 0 0 
5 10 20_ 64 0 0 


59 
47 


73 5 10 12 0 0 
9 2 5J^ 38 0 0 


.56 
.19 


.60 
.73 



Table 258. Pretest to Posttest Changes 
(The response choice for 18-A is cited first.) 



Item Pa 


ir 18-A, 15-B Percent Chanae. Pretest tn Pnct-f-oc*. 


Student 
Group 


Correct 
Choi ce 


Parallel Distractor Pairs 


A C A+C 


B B B+B 


C A C+A 


D D D+D 


Experi- 
mental 


+24 +31 +30 


"4 -8 -6 


"3 +4 +1 


-18 -26 -25 



Item pair 20-A, 17-B functions at the cognitive level of compre- 
hension. Mean net gain from pretest to posttest was 26 percent (from 
18 to 44 percent) . This is an entirely acceptable level of achievement 
which we attribute to the effect of instruction. Posttest achievement 
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FOR A Nrw BAbY TO mVi, fl SPERfl MUST GO FROM 20a rQR A NEW BABY TO BEGIN. A SPERfl MUST GO FROfI 

I TESTICLE I TO J VAGINA I to ^| UTERUS | to ^ 

I TESTICLE | _2^ [wGIf;r| to ^ to ^ [egg] 

Mark A'i X ON you" cmcice. 

f- ^,^ . 1 i- ~ I I I , I Mark an X OH your cmojce. 

LSPtP'* TUBE I [qvARY] [egg] | PENIS | 

£ c L [pEnTsI [uURUsI [OVARyI [SPERH TUBLj 

* fc c 

level was not as high as on item pair 16-A, 11-B, where a visual clue 
was given in addition to the word clue. Biserial correlation levels 
are average. 



Table 259. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of W 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


20-A 
17-B 


47 
59 


17 19 19 32 13 0 
20 17 25 34 3 0 


59 
47 


10 37 42 7 3 0 
9 47^ 26 13 7 0 


.39 
.28 


.34 
.34 



Table 260. Pretest to Posttest Changes 
(The response choice for 20-A is cited first.) 



Item Pa. 


Lr 20-A, 17-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C B C+B 


A D A+D 


B C B+C 


D A D+A 


Experi- 
mental 


t23 +30 +26 


"7 -21 -14 


+18 +1 +10 


-25 "11 -17 



Objective 404 . students will relate changes in life's continuum 
to human growth and development , six student activities and other 
instructional strategies were designed to develop student competencies 
to achieve this objective. 

For activities 15 to 17, 50 percent of the teachers reported using 
the strategies as described; 29 percent reported some modification; and 
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14 percent reported muc.i modification. Seventy-nine percent of the 



reported some difficulties. The ma]or ccniplaint received concerned the 
colors used on the daylight blackboard projection slides with most 
students desiring more realistic colors. The other problem was the 
difficulty in finding a mother willing to bring an infant into the 
classroom for a discussion of the proper care of the newborn. Also, 
the slide projected on the wall to measure height would not work in 
several classrooms where th.e projector could not be moved far enough 
away from the wall to project an image of the proper size. Most 
difficulties were overcome by teacher ingenuity or by telephone calls 
to the BSCS project staff. 



teachers reported that the strategies were successful and 21 percent 



Interest 
Disinterest 



Pleasure Willingness 
Displeasure Unwillingness 



100 



Percent of 
teachers 
(N=12) 



50 




57 57 



5 = high 
3 = neutral 
1 = low 



43215432154321 



Figure 134. Reaction of the majority of students 
to activities IZ to 17 



4 



100 



Percent 




Percent of 
teachers 
(N=12) 



5 4 3 2 1 



Important OK ■ Useless 

Figure 135. Importance to students of activities 15 to 17 
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erJc 



100 



50 - 




I 



100 



50 - 



Percent of 
teachers 
(N=12) 




All 1 i i <1 None 
4 2 4 4 



Figure 136. Proportion of 
students able to perform 
on cubobjectives of 
activities 15 to 17 



5 4 3 2 1 
i"iportant * OK- — - Useless 

Figure 137. Impoitance of the 
subobjectives 



Figure 134 shows that teachers rated student responses c 3 
positive across the three rating scales. Figure 135 shows the average 
rating of importance? across the three activities. Activity 17 re- 
ceived the lowest rating because some teachers felt that the grajf .inq 
of weight and height in Unit I was sufficient and this type of exe-cise 
need not be repeated. 

Figure 136 shows that student success on the siabob jectives , as 
estimated by teachers, was not as high for tliese three activities as 
for previous ones. The main problem centered around the graphing 
activities in activity 17- Figure 137 shows that teachers rated the 
importance of the subobjectives on the positive side of the scale. 

For activities - to 20, 61 percent oc the teachers reported 
using the strategies as described; 39 percent repc-Jted some modifica- 
tion. Ninety-two percent reported that the strategies were successful 
anc' eight percent (one teacher) reported some difficulties. In general, 
most comments were very posi:,ive, such as, "Activity 18 was great 
because kids got practice in measuring and reasoning. People who say 
these kids cannot reason should see the results of a lesson like this. 
We had to work a little harder with some of them but eventually through 
reason they did make accurate judgments." 



266 



Interest Pleasure Willingness 

Disinterest Displeasure Unwillingness 



100 

Percent of 
teachers 50 
(N-13) 




5 = high 
3 = neutral 
1 = low 



543215432154321 

Figure 138. Reaction of the majority of students 
to activities 18 to 21 



100 



Pe/cent 50 




I 



Percent of 
teachers 
(N=13) 



5 4 3 2 ] 
Important OK Useless 



Figure 139. Iirportance to students of activities 18 to 20 
Concerning activity 19, a typical comment was, "Activity 19 wai 
one of the highest motivational lessons we have had when the kids had 
to interpret the slides. All of them were busting to talk about them. 
The humor was the factor, I believe, that really turned the kids on." 

Figure 138 shows the teachers* rating of student reactions to be 
very high across the three rating scales. Ratings for activity 21 are 
included here because they could not be separated. Figure 139 shows 
that the overall average rating of importance for activities 18 to 20 
was high. 

Figure 140 shows that the proportion of students able to success- 
fully perform the behaviors specified by the subobjectives of activities 
18 to 20 ^ AS high, but not as high as for some previous activxties. 
Sixty-eight percent of the teachers estimated that three-fourths or 
more of tneir students were successful. Figure 141 snows that teachers 
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considered the subob jectives to be important 
100 , , 100 



Percent 50 





All 1 I I A None 
4 2 4 4 



Figure 140. Proportion of 
students able to perform 
on subobjectives of 
activities 18 to 20 



I 



5 4 3 2 1 
Important OK Useless 



Percent of 
teachers 
(IM-13) 



Figure 141. Importance of the 
subobjectives 



Two item pairs were designed to assess student achievement on 
objective 404. 

LOOK AT THE GRAPH OF JUDY'S WEIGHT. e& ' ' " ir ■ 

POUNDS 
120 
100 - 

m- 

60 

4n 

20 

0 



BIf'TH 6 YEARS 12 YUPS YLAPS 2^4 YtAR: 

mVi DID S«E GROW THE «DS! tUftllU il^lH AND b Y? AP:, hiUiiU 
6 m n YiAPS, B[Tkfl:N 12 AND J8 YEA?'.. ^^LT^llN 18 AND 2^^ ^EAft:-? 



_L 



BfTWEEN B!P^^ 


,Un.^EE« 6 1 


KTWEEN 12 






AND 6 YEARS 


i AND 12 YEAPS 1 


AND 18 tcAPS 




AND 24 YLAPS 


A 









::=T- t yEAPS 18 YEARS YEaPS 

'J-:'^ -E S'^OW T-E "CST' 5£T«EEN ti^lH AlO 6 YEAR3, BETWEEN 6 
12 VEi^s.^ ££|^rrf, 12 A'iD 16 ^cA^t,^ 5^7^^^:,^ YEARS^ 



HEThEEN 5PT- 
A';D 6 VtAPS 



HET»<E£'i 5 
AND 12 YEAPS 



■ETi^EE^ 12 
AND 18 (EAP3 



BETWEEN 18 
AND 2H YEAPS 



Item pair 6-A, 2-B functions at the cognitive level of analysis. 
Mean net gain from pretest to posttest wrs 20 percent (from 7 to 27 
percent) , but the posttest achievement level was still low. Most 
teachers recommended using two different types of shading and alter- 
nating these in the bars on the graph to aid in visual discrimination. 
In spite of the high difficulty level, we believe that shading will 
increase success and that this item pair could be a valuable diagnostic 
tool for teachers, 



ERLC 
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Table 261. item Responses and Biserial Correlation's 
for Experimental Group 



Student 
Group 


Item 
# 




Pretest 


Post test 








Percent of N 




Percent of N 






N 


A B C D M 


0 


N 


A 


B C D M 0 


Pre 


Post 


Experi- 


6-A 


47 


13 6 13 43 26 


0 


59 


29 


27 12 25 7 0 


• 60 


.38 


mental 


2-B 


59 


7 14 20 54 b 


0 


47 


28t 


19 11 32 11 0 


.15 


.24 



Table 262. Pretest to Posttest Changes 
(The response choice for 6-A is cited first.) 



Item Pa: 


Lr 6-A, 2-B 


Percent Chamge, Pretest to 


Posttest 




Student 
Group 


Correct 
Choice 


Parallel Distractor 


Pairs 




B A B+A 


A B A+B 


C C C+C 


D D 


D+D 


Experi- 
mental 


+21 +21 +20 


+16 +5 +11 


-1 -9 -5 


-18 -22 


-21 



M PEOPLE AUAYS NEED. LOVE. CANDY., CARS. ULEVlSIOr 19. B'BIES ALKAYS NEED LOVE. CAtfflY. BIC CLES. Bi;VKEP 20e 

Hark an X on vour choice. m « . v 

fWBK *N X OH YOUR CHOKE. 

[I^ [cAiY] [cp] Q™] [Tp«] ^ ^ 

s C 1 

Item pair 19-A, 20-B functions at the cognitive level of knowledge. 
Mean net gain from pretest to posttest was 15 percent (from 72 to 87 
percent) indicating that this item also provides baseline information. 
The most notable shift w,>s from choosing television and blanket to 
love. Considering the relatively high pretest level, the posttest 
level is very good and we attribute this gain to the effect of instruc- 
tion. The biserial correlations are excellent. 
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Table 263. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M 0 


A B C D M 0 


Pre 


Post 


Experi- 
mental 


19- A 

20- B 


47 


74 6 9 11 0 0 
71 3 3 22 0 0 


59 
47 


86 2 7 5 0 0 
89 2 0 9 0 0 


.55 

.50 


.59 
.73 



Table 264. Pretest to Posttest Changes 
(The response choice for 19-A is cited first.) 



Item Pair 19-A, 20-B Percent Change, Pretest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


A A A+A 


B B B+B 


C C C+C 


D D D+D 


Experi- 
mental 


+12 +18 +15 


-4 -1 -2 


-2 -3 -2 


"6 -13 -10 



Objectiv e 405 , Students will account for the phenomena that 
have contributed to the development of ME_ NOW . One student activity 
and other instructional strategies were designed to develop student 
competencies to achieve this objective. 

All teachers reported using the strategies as described and 
reported that they were successful. No figure is reported here for 
teachers* assessment of student reaction because it was contained with 
activities 18 to 20 and was impossible to separate. Comments from 
teachers on activity 21 and on the whole program were very positive and 
complimentary. One example is, "I was happy to find that there was 
little trouble getting acxoss what a trait is. I did this by saying 
all things that make you are traits. Also the kids did a great job 
distinguishing inherited traits from learned traits. They did so much 
faster and with much more ease than I thought they would. 

ERLC 
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"I had one girl who could not caste P*T*C* paper when all her 
family could. She was kind of shook until the grandparent explanation 
was given to her. I also had one boy who had a sister who could not 
taste it while others could. This was a good lesson to reinforce the 
idea of inherited traits. 

"Final comment — This entire program was sensational from start 
to finish. It was a joy to this teacher and tremendously accepted by 
all of my students. Thank you from all of us." 

Figure 142 shows that teachers considered activity 21 to be 
very important. 100 



Percent 50 




I 



Percent of 
teachers 
(N=13) 



5 4 3 2 1 
Important OK ■ *■ Useless 

Figure 142. Importcince to students of activity 21 

Figure 143 shows that the teachers' estimate of students ability 

to perform the behaviors specified by the subobjectives of activity 21 

was high. Eighty-five percent of the teachers reported that three- 

fourths or more of their students were successful. Figure 144 show<^ 

that teachers considered the subobjectives to be important to EMU students. 
100 I ^ 00 



Percent 50 - 




54 

o I H ■ ■ — 



I 



All i i i <i ^one 
4 2 4 4 



Figure 143. Proportion of 
students able to perform 
on subobjectives of 
obT^ctive 405 



Percent of 
teachf^rs 
(N-13) 



5 4 3 2 1 
Important OK > Useless 

Figure 144. Importance of the 
subobjectives 
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One item pair was designed to assess student achievement on 
objective 405. 



rir iii T-t -I'.TL-* '>F >i EOY. wH!c^^ OF imzi was wt 



LOO* AT THE PKVd^i Of T^L GI=L iiWC^ OF THtS[ WAS NOT 
IN-rsiTEI' FCQv H^o OAPifn: STYLE, tYL COLOR IW'JTH 



[haip style! [eye color I [toh] (nosT 



Item pair 10-B functions at the cognitive level of knowledge. 

Mean net gain from pretest zo posttest was only one percent (from 68 
to 69 percent) • Comments from most teachers indicated that they were 
very rushed during the final days of school to finish ME NOW and adminis- 
ter posttests and, unfortunately, this last activity did not really 
receive the attention it deserves. We are confident that the posttest 
level of success would improve with the proper presentation of the 
matei ials , 

Table 265, Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 


^b 


N 


Percent of N 


N 


Percent of N 


A B C D M O 


B c D M n 


Pre 


Post 


Experi- 
mental 


1-A 
10-B 


47 
59 


17 11 66 6 0 0 
69 19 7 5 0 0 


59 
47 


15 7 61 37 0 0 
79 6 11 4 0 0 


,06 
,66 


,49 
,1P 



Table 266, Pretest tc Posttest Changes 
(The response choice for 1-A is cited first,) 



Item Pair 1-A, 10-B Percent Change^ Protest to Posttest 


Student 
Group 


Correct 
Choice 


Parallel Distractor Pairs 


C A C+A 


B B B+B 


A C A+C 


D D D+D 


Experi- 
mental 


-5 +10 +1 


-4 -13 -8 


--2 +4 -2 


+11 -1 +6 
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One item pair was included to measure concepts learned in Unit II. 

rfH:T p£ci cA-'^ir. ^m'^'i in Att p*'=ts t-e iOjn 2* wniT p:rt cajipies food to all pa?ts af Tnf 3c:y^ ii 

AS X IN T^iE CI=»CL£ --f* ■'Mt l!S£ ThaT TCJChES TmAT P*RT. *1aR< aN X IN Tm£ CiP(.LF Tm£ lINL ThAT fivJCHEi TmAT PART. 




Item pa.\r 2- A, 1-B functions at the cognitive level of compre- 
hension. The pretest and posttBSt levels of 39 and 44 percent are 
somewhat lower than es^ected. A careful examination of the items 
indicates that proper interpretation hinges on the word "carries." A 
large number of students, especially in Form A (64 and 61 percent) are 
choosing the lung. :ie interpret this result as a problem with the item 
and not with student memory. 



Table 267. Item Responses and Biserial Correlations 
for Experimental Group 



Student 
Group 


Item 
# 


Pretest 


Posttest 




N 


Percent of N 


N 


Percent of N 


A B C D M O 


A B C D M 0 


Pre 


Post 


Experi- 
mented 


2-A 
1-B 


47 
59 


64 6 4 21 4 0 
53 7 27 14 0 0 


59 
47 


61 2 3 34 0 0 
57 2 32 9 0 0 


-.20 
.56 


.39 
.40 



Table 268. Pretest to Posttest Changes 
(The response choice for 2-A is cited first.) 



Item Pair 2-A, 1-B 


Percent Chanqa , Pretest to 


Posttest 




Student 


Correct 
Choice 


Parallel Distracts 


r Pairs 




Groi^) 


D A D+A 


A D A+D 


B Z B+C 


C B 


C+B 


Expori- . 
mental 


+13 +4 +5 


-3 -5 +2 


-4 +5 -3 


-1 -5 


-3 
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Obj ective Achievement Tests 



Descriptive Data and Interpretation . Pretests were administered 
to experimental classes between March 8 and May 14, 1971; no control 
group was used for Unit IV. Posttests for the experimental group were 
administered between June 7 and June 18, 1971. 

Raw score frequency distributions on the Unit IV tests for the 
experimental group eire shown in Table 269. Table 270 provides a 
su-nmary of student background data for the ten experimental classes. 
Table 271 provides more descriptive data on pretest, posttest and 
residual gain scores. The interpretations that follow are based upon 
data provided in these tables. 

1. Although the number of experimental classes was reduced from 16 to 
ten, the mean age and WISC IQ scores have not changed significantly 
from those of the 16 class group. 

2. Students using Forms A and B in the experimental classes achieved 
scores outside of the range of the standard error of measurement 
for both pretests and posttests, indicating differing degrees of 
knowledge between classes prior to instruction and after instruction. 

3. Posttest reliability was satisfactory for Form B (.73), but slightly 
low (.64) for Form A. Four of the ten experimental classes showed 
positive mean residual gain scores. Visual inspection indicates two 
classes (22 and 27) with extremely high residual gain scores and 
the remaining classes clustered around the mean score for the ex- 
perimental group. 
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Table 269, Frequency Distribution of Raw Scores for 

Test Formi". A and B, Experimental Group s 



Experimental Groups 







Pos t 


Pre 


Post 


Scorrs 


A 


B 


B 


A 


19-20 




2 




2 


17-18 




6 




2 


15-16 


1 


11 


3 


9 


13-14 


1 


9 


5 


16 


11-12 


1 


5 


9 


14 


9-10 


9 


7 


8 


10 


7-8 


13 


7 


20 


2 


5-6 


14 




9 




3-4 


6 




5 


1 


1-2 


2 








0 










Totals 


47 


47 


59 


59 



Multiple Stepwise Reg r ession Analysis 



Experimental Groa£. Unit IV. To determine the effect on posttest 
scores, if r-y, of the independent variables, the following question 
was inv-otigated: "Is there a significant dif fere- in the level of 
achievement on the posttest among students in EI'H classes having dii.- 
farent background variables?" 

The following independent variables were used to test this ques- 
tion: sex, age, WISC Full Scale IQ, race, teachers' assessment of 
reading achievement, teachers' assessment cf verbal participation, and 
pretest score. All student scores were pooled anri treated as the 
results of one test. 
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Table 272. Results of Multiple Linear Regression Analysis, 
Experimental Group, Unit IV. N = 101 



Independent Variable 



Sex .1062 

Age -.0414 

Wise Total IQ .0749 

Reading Achievement 1.0495 

Verbal Participation -.2848 

Pretest .5314 



SB. 
1 



.5560 
.0169 
.0352 
.9396 
,2322 
.0985 



♦significant at the .05 level, F = 3.95 

. 05 (1 , 94 ) 

♦♦significant at the .001 level, F qq-j^^ 



.0364 
5.9965* 
4.5111* 

19.18** 
1.50 

29.1360** 



= 11.68 



The F-value for each independent variable determines the level at 
which that variable is a significant predictor of a score on the post- 
test instrument. 



Discussion 

The data indicate that sex and verbal participation are not signif- 
icant predictors of success on the posttest; the F-level for race was 
insufficient to enter into the regression equation. The pretest and 
residing achievement are highly significant predictors of success on 
the posttest (P<.001). Age and WISC Full Scale IQ are also significant 
predictors of success on the posttest (P<.05). These results indicate 
that prior knowledge of the co -^epts measured by the test instrument and 
the teachers' assessment of reading level were the best determinants 
of whether or not the experimental group students attained high scores 
on the posttest. Test analysis shows that only two of the 20 items were 
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aimed at baseline information and that 14 of the 20 items involved 
cognitive levels higher than recall. There are also more words in th^^ 
response choices than in previous tests, which could explain why 
reading achievement was such a high predictor of posttest success. li 
did not attain the high predictive value for Unit IV that it had on all 
previous tests. Cider students achieved slightly higher scores than 
younger students and girls scorsd slightly higher than boys. This 
result was expected since girls reach puberty at an earlier age than 
boys and most of the girls in the experimental group are at the age of 
the onset of puberty and should already know or at least feel the need 
to know more about sexual development than younger girls or boys. 



Table 273. Matrix of Correlation Coefficients 
Experimental Group, Unit IV 





Age 


Reading 
Total Achieve- 
IQ Race ment 


Verbal 
Partici- 
pation 


Pre- 
test 


Post- 
test 


Sex 


-.093 


-.122 -.084 .232 


-.029 


-.097 


.064 


Age 




.083 . 331 ,212 


.027 


.408 


.047 


Total IQ 




-,076 .374 


.357 


.330 


.482 


Race 




-.305 


-.231 


-.227 


.153 


Reading 
Achieve- 
ment 






.441 


.190 


.486 


Verbal 
Partici- 
pation 








.238 


.253 


Pretest 










.505 


since 


IQ and reading level are quite highly correlated (.374), 


much 


of the variance 


accounted for by reading level 


would also 


be accented 


for by IQ, 


This 


is a probable cause of the results of the multiple 





regression analysis. 
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Table 274. Multiple Stepwise Regression Analysis 
Experimental Group^/ Unit IV 



Step 
Num- 
ber 


Variable 
Entered 


Multiple 

2 

r r 


Increase 
in r 


F-Value 
to Remove 


No. of 
Independent 
Variabl'^s 


1 


Pretest 


.5049 


.2549 


.2549 


33.8702 


1 


2 


Reading 
Achieve- 
ment 


.6424 


.4127 


.1578 


26.3354 


2 


3 


Age 


.6845 


.4686 


.0558 


10.1935 


3 


4 


Total IQ 


.S995 


.4893 


.0207 


3.9001 


4 


5 


Verbal Par- 
ticipation 


.7055 


.4978 


.0084 


1.5954 


5 


6 


Sex 


.7057 


.4980 


.0002 


.0364 


6 




The effect of 


the pretest 


accounts 


for approximately 25.5 


percent 


of the variance in 


the regression equation. The combination of pretest 



and reading achievement accounts for 41.3 percent and when ac;e is in- 
cluded the total is 46.9 percent. The inclusion of all independent 
variables except race, whose F-level was insufficient to enter into the 
regression equation, accounts for 53.5 percent of txie variance - This 
result compares favorably with the results fo,r previous units. The low 
significance levels for sex, age, and IQ are encouraging. 

Objective Achievement Tests * 

Analyses of Variance and Cjvariance , Experimental Group , Urit IV. 
Two statistical tests wer'5 performed to investigate the question, "is 
there a significant difference between experimental classes in the level 
of achievement on the Unit IV posttest?" The results of an analysis 
of covariance are summarized in Table 275 and indicate a significant 



280 



difference between classes on posttest means adjusted for differences 
in pretest scores. 



Table 275, Analysis of Covariance Between Classes 
on Adjusted Unit IV Postt^t Means ^ Pretest as Covariate 



Source 


d.f • 


F-Rat.i o 


Between Groups 


9 


4,8224** 


Within Groups 


90 





♦♦significant at the .001 level, F^^^^^^ = 3.53 

An analysis of variance was also coE.^uted between experimental 
classes with residual gain scores as the dependent variable. Table 276 
shows the results of the analysis of variance, indicating a significant 
difference between classes on residual gain scores. The pretest, post- 
test, and residual gain means are summarized in Table 271, page 276. 



Table 276, Analysis of Variance Between Classes 
on Residual Gain Scores, Experimental Group, Unit IV 



Source d.f. Mean Square F-Ratio 



Between Groups 9 28.3863 4.8697** 

Within Groups 91 5.8291 



*'S:gnificant at the .001 level, F^^^^^^ = 3.54 

This result confirms that of the analysis of covariance. 
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Discussion 

The results of the analyses of variance and covariance confirmed 
the results of a visual inspection of Unit IV scores. Classes 22 and 
27 were clearly superior to the other classes and apparently classes 21 
and 35 were inferior. The time available for instruction in Unit IV 
could have influenced the results. All other classes are clustered 
around the mean posttest level. 

^^^ysis of Variance , Experimental Group . The results of the 
multiple linear regression on the posttest indicated that reading achieve- 
ment (P<.001), age, and WISC Full Scale IQ (P<.05) are significant pre- 
dictors of success on the posttest. The reduced N for Unit IV precludes 
the possibility of a three-wa^ analysis of variance because of the number 
of empty cells and the small number of replications per cell that would 
result. In previous units, only those independent variables from the 
multiple regression significant at the .01 level and beyond have provided 
significant differences in subsequent analyses of variance. Because of 
previous results, residual gain scores were blocked on five levels of 
reading achievement: readiness and first grade, second grade, third 
grade, fourth grade, and fifth grade. An analysis of variance was per- 
formed on the five levels to determine if there were any significant 
differences between levels. The following question was then investigated: 
"IS there a significant difference in residual gain scores between stu- 
dents blocked on five levels of reading achievement?" 

Table 277 contains the results of the analysis of variance, indi- 
cating a significant difference between reading levels. Table 278 
summarizes the tl, means, and standard deviations for the residual gain 
scores in each cell. 
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Table 277, MQVAy Residual Gain Blocked on Reading Achievement 
Experimental Group ^ Unit IV 



Source 


d.f . 


Mean Square 


F-Ratio 


Between Groups 


4 


49.4999 


8.0826** 


Within Groups 


96 


6.1243 





**Significant at the .001 level, F = 5.11 

^ .001 (4,9o; 



Table 278* Mean Residual Gain Scores and Standaifd Deviations 
for Reading Levels, Experimental Group, Unit IV 



Reading Level 


N 


Mean 


Standard Deviation 


Fifth Grade 


6 


1.8376 


2.3407 


Fourth Grade 


15 


2.0197 


1.8505 


Third Grade 


23 


.1054 


2.8004 


Second Grade 


31 


.3360 


2.7239 


Readiness and 
First Grade 


26 


-2.0829 


2.1677 



Discussion 

The analyses of variance were computed on the five reading levels 
and the results indicate that there is a significajit difference in 
residual gain scores between levels (r<.001). Visual inspection indi- 
cates three performance levels: fourth and fifth grades, third and 
second grades, and readiness-first grade, with the tendency for the 
higher reading levels to achieve higher residual gain scores. As 
indicated previously, this result is probably due to the increac^ed 
demand for reading on the Unit IV tests. 

ErJc 
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Factor Analysis ♦ To determine the structure of the Unit IV 
achievement tests, a Harris-Kaiser oblique, unnormalized, orthogonal 
rotation was performrd on the results of posttests A and B. For post- 
test A, 12 factors were identified which accounted for 48 percent of 
the variance. For posttest B, 13 factors were identified which accounted 
for 56 percent of the variance. 

Table 279 presents the results for posttest A, showing only those 
factors with eigenvalues cibove 1. The objective measured and cognitive 
level of each item is included, as is a hypothetical name for each factor. 
Table 280 presents the results for posttest B, showing only those factors 
with eigenvalues above 1. 



Table 279. Factor Structure - Unit IV, Posttest A 



Factor 


Items 


Cognitive 
Level 


Objective 


Name 


1 


6 


high 


404 


chapter overview 




7 


low 


403 






9 


knowledge 


400 




2 


6 


high 


404 


attitude toward body 




13 


attitude 


401 


functions 




17 


attitude 


401 




3 


4 


low 


403 


conception - fetus 




12 


knowledge 


403 


development 




20 


low 


403 





erJc 
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Table 280, Factor Structure - unit IV, Posttest B 



Factor 



Cognitive , . 
Items Obiective 
Level 



Name 



2 
3 



^ low 403 conception - umbilicus 

high 403 attachment 

15 knowledge 403 menstrual cycle 

1 low Unit II Unit II recall 



Three of the four items found in posttest B factors (with eigen- 
values above 1) have their corresponding Form A item in the posttest A 
factor analysis. Posttest A factors are evenly distributed across the 
test, but posttest B factors deal almost entirely with objective 403. 
Since objective 403 was the focal point of Unit IV, the results from 
posttest B are not surprising. 



Siammary 

Pretest to posttest gains were exceptionally high for Unit IV, 
indicating a significant effect due to instruction. Students with high 
reading ability achieved a higher level of success than students at low 
reading levels. This is attributed to the amount of reading involved 
in the test itself and not to the instructional program. Achievement 
test results identified some problems with the items themselves and 
some instructional problems that have resulted in modifications of 
the tests and the instructional materials. Teacher feedback has been 
invaluable in improving the experimental materials. Student interest 
and motivation for Unit IV has been higher than with any previous unit. 



CHAPTER VI 
SUMMARY AND CONCLUSIONS 



The major purpose of this formative evaluation is to formalize the 
data ard interpretations of data that were provided to the team of 
writers revising the experimental materials. Specific suggestions for 
changing and improving are contained within the discussion of each ob- 
jective within each chapter and will net be repeated in this summary. A 
general description of outcomes for the entire program are presented 
first, based on the questions posed in the evaluation model (see Table 1, 
page 11). The questions are not repeated, but the discussion follows the 
same sequence. The conclusions, following the summary, are presented 
unit by unit to point out important results. The concluding section in- 
cludes the major revisions that were made in the revised materials. 

j^at Were the Results of the Formative Evaluation ? 

Students in the 1970-71 field test were within the prescribed limits 
of age and ly for which the materials were designed. Table 3 (in Chap- 
ter I) provides a summary of background variables for students in the ex- 
perimental group. Table 4 provides this information for students in the 
control group. These tables also indicate the number of students outside 
the prescribed IQ and age limits in both groups. 

Pretest scores indicated that many students could perform the be- 
haviors specified by the objectives and subobjectives prior to instruc- 
tion in Unit I. This is by design. The writers wanted the students to 
experience success early in the program to provide more stimulation and 
enthusiasm. Nine of 30 Unit I test items provided baseline measures of 
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student achievement. In subsequent units, activities relied less on 
prior knowledge, and the general trend of baseline type items declined 
from nine in Unit I to two in Unit IV. 

Most teachers reported tliat they used the strategies as described. 
A few reported minor modifications and fewer still reported major modifi- 
cations. No funds were available for either videotaping teacher presen- 
tations or for providing classroom observers to verify teacher reports of 
fidelity to strategies. Experience from the previous year's testing plus 
data from a limited number of staff visits to test classrooms lead us to 
doubt the high percentage of fidelity to the strategies reported. 

The mean number of hours of instruction for each unit was well with- 
in the prescribed time limit of 30 minutes per day, five days per week, 
lasting from four to six weeks. Under normal classroom conditions, 
however, and with the goal of teaching for a mastery level of student 
achievement, ME NOW is a full two-year program. 

Teacher reports indicated that the overall student success ratio 
was high on the behaviors specified within the program. Where specific 
difficulties were identified by teachers or by achievement tests, re- 
visions were made in strategies, materials or procedures. 

In Units ll and IV, a wide divergence of teacher fidelity to 
strategies occurred. These were the only units where significant 
differences were found between classes in the level of student achieve- 
ment. The evidence indicates that the desired student responses will 
occur if teachers follow the prescribed strategies. 

Teachers' comments on feedback forms were extremely valuable to 
the revision team in producing the revised edition. In general, 
teacher reaction to materials and strategies was overwhelmingly 
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favorable* The major problems in materials were encountered with 
temporary equipment that will be replaced by the functioning torso 
in the commercial edition. Some problems were also encountered with 
films, but seven films designed specifically for use with ME NOW are 
available with the commercial edition and should enhance as well as 
strongly reinforce learning with the revised edition. 

It is very difficult for a teacher who is used to lecturing to a 
class to modify his or her behavior in order to become a guide for 
student activities. Most experimental teachers made this shift, but 
in varying degrees. Teachers who were completely successful in chang- 
ing their behavior indicated a high degree of student enthusiasm and 
motivation in their new role. 

The students' reactions to the materials, according to teacher 
reports, were overwhelmingly positive. Quotes from teachers regarding 
student attitudes and reactions are contained in previous chapters 
and will not be repeated here. Both teachers and developers were ex- 
tremely well pleased with fiiese results. For most students, ME NOW 
has provided the first opportunity to "put their hands on things," to 
manipulate equipment and to draw their own conclusions on data they 
have collected. 

Teachers' estimates of the proportion of students able to success- 
fully perform specified behaviors were generally high throughout the 
program, where low success levels were reported, an attempt was made 
to determine if the problem was related to teaching strategies, mate- 
rials, leveJ of difficulty, etc.; and appropriate revisions were made. 
Mean total gains from pretest to posttest were achieved in all four 
units by students in the experimental group, and the posttest level of 
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achievement was satisfactory for all units and spectacular in Unit IV • 
Gains were evaluated by calculating simple pretest-to-posttest gains, 
gains from pretest scores to adjusted posttest scores, and residual 
gain scores. Adjusted posttest scores and residual gain scores were 
calculated to minimize the effect of a regrec?sion to the posttest 
mean, inherent in any pretest-posttest design. That is, those students 
scoring high on the pretest will tend to score lower or regress to the 
posttest mean level of achievement, and those students who scored low 
on the pretest will score higher on the posttest. This effect occurs 
without instruction taking place and must be accounted for in the 
evaluation. 

In Units I, ll and ill, students in the experimental group scored 
significantly higher on adjusted posttest scores and on residual gain 
scores than similar students in the control group. No control group 
was used in Unit IV, but the level of the gains was so spectacular that 
there was no doubt that instruction had produced a significant effect • 

What Were the M_ajor Conclusions from the Evaluation? 

1. The data indicate that students learn during exposure to the mate- 
rials of ME NOW and attain levels of aciiievement that are signif- 
icantly higher than similar students in a control group not ex- 
posed to ME NOW. 

2, In Units I, II and III, students in the experimental group with 
Wise Full Scale IQ scores between 67 and 79 attained posttest 
achievement levels equivalent to or significantly higher than 
students with WISC Full Scale IQ scores of 80 or above. 



In Units I, II and III, students in the experimental group with 
Wise Full Scale IQ scores between 67 and 79 attained posttest 
achievement levels significantly higher than students with WISC 
Full Scale IQ scores of 66 or below. 

In Unit IV, the level of gains from pretest to adjusted posttest 
scores was far beyond the level expected by the developvrs, and 
the achievement level was virtually independent of V/ISC Full 
Scale IQ scores. 

Based on conclusions 1, 2 and 3, we feel that the ME NOW materials 
are suitable for the population of educable mentally handicapped 
children for whom they were designed. 

In Units I to IV, pretest scores were the best predictors of 
posttest scores on the alternate test forms. 

In Hnits I, II and III, males attained higher levels of achieve- 
meni- than females although the difference was not statistically 
significant. 

In Unit IV, females attained higher levels of achievement than 
males although the difference was not statistically significant. 
Race of the students in the experimental group had no determining 
effect on achievement level. In Units m and IV race did not 
account for enough variance to enter into the regression equation 
of the multiple stepwise regression. 

In Unit IV, teacher's assessment of reading level was a highly 
significant predictor of success on the posttest. This is 
attributed to reading involved in the test and not to any reading 
effect during instruction. 

A gross ignorance of the process of menstruation was evident among 
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girls in the experimental group prior to instruction in Unit IV. 
Since many females encounter the onset of puberty ac the age level 
of ll to 13, instruction with materials similar to Unit IV of 
ME NOW should be emphasized. 
12. The ME NOW program is based on a philosophy of uirough 
inquiry. Throughout the period of instruction, student success 
was heavily dependent on teacher fidelity to instructional 
strategies. In view of these results, we strongly recommend that 
teachers undergo sufficient training to acquaint them with the 
philosophy and rationale of the program, prxor to attempting any 
classroom instruction with ME NOW . 

What Were the Major K3visions Suggested for the Revised Materials ? 

The following are the major additions to the ME NOW materials, 
in addition to the changes cited in the evaluation of student achieve- 
ment in the previous chapt'^rs. 

1. Application and/or extensions to the lessons have been added to 
help the teacher broaden the effective use of ME NOW* Many 
activities relate directly to health, safety, nutrition, etc., 
and logical entry points from ME NOW have been provided to these 
areas • 

2. Instructional assessments similar to the questions used in the 
achievement tests have been included at the particular point in 
instruction where any of the test items measure achievement. In 
this manner, teachers can assess student achievement on a regular 
basis and not wait until after completing the unit to find out 

ERLC 
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if the students have mastered the concepts. 
3« C n:- ^ave been added throughout the guides to renlnd teachers 

Oil appropriate teacher behaviors necessary in inquiry teaching. 
4. The teacher's part of the suggested dialogue has been shaded to 

draw the teacher's attention and facilitate the use of the guide. 

Summary 

Dr. Gaston E. Blom stated, "Children with handicaps have greater 
concerns about their bodies, body parts, and body functioning than do 
normal children. These concerns, both realistic and irrational, in- 
fluence their self-concepts and many of their behaviors, inc^.uding 
learning. " 

After extensive classroom trials and revisions, we believe that 
ME NOW capitalizes on the concerns of the EMH child and provides an 
effective program of instruction to help him learn more about his 
body and how it functions. We are grateful to the U. S. Office of 
Education, Bureau of Education for the Handicapped, for providing the 
funds necessary for the development of ME NOW. 



Blom, Gaston E. "So^^e Considerations TVbout the Neglect of Sex 
Education." The Journal of Special Education , Vol. 5, No. 4, 
pp. 359-61. (Winter, 1971) 

O 
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APPENDIX I. CONTROL CLASSROOM TESTING SCHEDULE 



Pretest, unit I 



November 2-6 



Posttest, Unit I 



January 11-15 



Pretest, Unit I I 



January 11-15 



Posttest, Unit II 



February 15-19 



Pretest, Unit ill 



February 15-19 



Posttest, Unit m 



March 29-April 2 



Pretest, Unit iv 



March 29-April 2 



Post test. Unit IV 



May 24-May 28 
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BIOLOGICAL SCIENCES CURRICULUM STUDY 

UNIVERSITY OF COLORADO • P.O. BOX 930 
BOULDER. COLORADO 80302 

APPENC'IX II 



ME i^JOW 
Life Science 
1970-71 
Experimental Materials 

The formative evaluation of the experimental Life Science materials 
"Me Now" is designed to secure data to answer a series of questions re- 
garding the characteristics of the students in the trial classes. The 
class enrollment form is one of the data reporting forms to gain in- 
formation about the students. All information will be regarded as 
confidential and used only in the evaluative process of the Life 
Science program. 

Directions for the completion of the class enrollment form. 



Top left corner: 



Top middle: 



Top right: 



Be sure to supply complete information in this 
section. The information given will help us 
to keep our files straight and make the re- 
cording of data easy to handle. 

This information will facilitate contacting 
you when school is not in session. 

School district information must be supplied; 
these data will enable us to describe the 
experimental population more accurately. Be 
sure that when you circle a school descriptor, 
you circle one category in line (a) and one 
category in line (b) . 



Column 1: 



To facilitate the data processing by a com- 
puter, all students will be assigned an I.D. 
number by BSCS . Student names cannot be used 
in data processing. 



Column 5: 



Intelligence test data. If the child has not 
had a WISC test, enter the Binet test score 
under total test or other test score that is 
available and indicate the name of the test 
given. 



Column 6: 



Ethnic background. Circle the appropriate 
group. (1) Caucasian or white; (2) Negro or 
black; (3) Spanish American or Puerto Rican; 
(4) other such as Indian or Oriental. If 
other is circled, please write the ethnic 
background for the student above the numbers 
in column 6 . 



Column 7: 



Reading achievement data is your judgment of 
the child^s performance in the classroom 
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reading you require him to complete • Circle 
the appropriate grade level that best describes 
his reading skill. R is reading readiness 
level, 1 is first grade, etc* 

Describe in your judgment the student's ability 
to participate in class discussions • We are 
interested in your opinion of the student's 
ability to interact verbally. The scale is 
arranged so that Low (1) would be a non-verbal 
student and high would be a student who is 
able to carry out a good relevant verbal inter- 
action. 
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APPENDIX IV. OBJECTIVES AND SUBOBJECTIVES 



I. DIGESTION & CIRCULATION 

Terminal Objective 100. Students will associate food with generalized 

body needs. 

Subobjective 1. Students will observe evidence of their 
growth and relate it to food. 

2. Students will describe particular uses of 
food from their own experience. 

Terminal Objective lol. Students will associate food types with plant 

and animal sources. 

Subobjective 1. Students will distinguish between animal and 
plant food sources. 

2. Students will identify the animal source of 
specific foods* 

3. Students will identify the part of the plant 
where specific foods grow. 

Terminal Objective 102. Students will recognize differences in 

physical characteristics of foods. 

Subobjective 1. Students will recognize that foods are composed 
of solids and liquids. 

Terminal Objective 103. Jtudents will relate structure with function 

of mouth parts . 

Subobjective 1. Students will associate the teeth with 

chewing, and the tongue with chewing and 
tasting. 

2. Students will associate the tongue with 
distinguishing tastes* 

3. Students will observe and describe tlie 
secretion of saliva in the mouth. 

4. Students will relate functions of teeth, 
tongue, and saliva in the mouth to 
characteristics of foods. 
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Terminal Objective 104 • Students will relate location of the mouth and 

stomach to structure and function of the 
esophagxis. 

Subobjective 1. Students will observe, describe, and develop 
ideas about the passage of food from the 
mouth to the stCHnach. 

Terminal Objective 105. students will relate stomach functions to 

digestion. 

Subobjective 1. Students will describe external evidence 
of stomach activity. 

2. Students will observe and describe effects 
of simulating the churning actions of the 
s tomach « 



3. Students will observe and describe the 
solubility of sugars in water. 

4. Students will observe and interpret a 
laboratory test to determine the presence 
of sugar in a solution. 

5. Students will perform and interpret a 
laboratory test to determine the presence 
of starch in a food. 

6. Students will determine the presence or 
absence of starch and sugar in a variety of 
foods. 

7. Students will associate "digestive juices" 
with the conversion of starch to sugar. 

8. Students will observe and describe the 
effects of digestive juices on foods. 

9. Students will review and describe the process 
of digestion from the mouth through the 
stomach. 

. Objective 106. Students will construct inferences about the 
functions of various parts of the circulatory 
system. 

Subobjective 1. Students will observe external evidence of 
circulation. 

2. Students will locate, observe, and describe 
evidence of heart activity. 



Subobjective 3. 

5. 
6. 
7. 

Terminal Objective 107. 

Subobjective 1. 

2. 

Terminal Objective 108. 

Subobjective 1. 

2. 



Students will associate heart actions with 
heart sounds . 

Students will associate heart actions with 
pulse . 

Students will associate heart actions with 
heart sounds and pulse. 

Students will associate the circulation of 
blood with heart action and pulse. 

Students will make and explain a simple 
diagram of the circulatory system. 

Students will construct an inference about 
the relationship between food and blood, 
and describe the barriers between them. 

Students will trace the pathway of food 
from the mouth to the intestine. 

Students will trace the remainder of the 
digestive tract, and speculate about the 
fate of digested food in the intestine. 

Students will observe and describe movement 
of substances through membrane barriers. 

Students will compare the permeability of 
a membrane to solids and to liquids. 

Students will observe and describe movement 
of substances in solution through two 
membrane barriers • 

Students will review and describe the 
processes of digestion and circulation. 



302 



Ul^IT II. PESPIRATION & BODY WASTES 
Terminal Objective 200 



Subobjective 1, 



Terminal Objective 201. 



Subobjective 1. 



Terminal Objective 202- 



Subobjective 1, 



Terminal Objective 203. 



Students will infer that breathing is a 
necessary life process. 

Students will associate internal body parts 
with external evidence of breathing. 

Students will associate internal body parts 
and external evidence of breathing with 
the flow of air in and out of the body. 

Students will associate breathing with the 
exchange of oxygen and carbon dioxide. 

Students will infer that oxygen is necessary 
for life. 

Students will identify respiration as a 
necessity for body action. 

Students will associate increased body 
activity with the need for additional food 
and oxygen. 

Students will associate food and oxygen 
with muscle activity. 

Students will infer the need for an oxygen/food 
distribution system to the muscles, and 
identify the blood as part of that system. 

Students will infer a relationship between 
waste and internal body processes. 

Students will recognize that water and 
carbon dioxide are products of energy release. 

Students will relate specific excretions to 
specific regions and actions of the body. 

Students will recognize, recall, and be able 
to synthesize concepts presented in the Unit. 



Subobjective 1. 



Students will interpret and explain animated 
cartoons depicting Unit concepts. 
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III. MOVEMENT, SUPPORT, & SENSORY PERCEPTION 

Terminal Objective 300. Students will associate bones and muscles 

with body movement, support, and balance. 

Subobjective 1. students will determine how muscles work. 

2. Students will determine how muscles and bones 
work together. 

3. Students will associate body strength and 
endurance with muscle development. 

4. Students will identify protective functions 
of bones and muscles. 

5. Students will determine that muscles and 
bones are necessary for support and balance. 

Terminal Objective 301. Students will associate senses with conscious 

and unconscious control of body activity. 

Subobjective 1. Students will identify the senses. 

2. Students will identify senses used in 
recognizing their surroundings. 

3. Students will determine the influence of 
senses on body activity. 

Terminal Objective 302. Students will associate the brain with control 

of body activity. 

Subobjective 1. Students will determine that the brain directs 
conscious and unconscious activity. 

2. Students will determine that brain receives 
and sends information from and to the body. 

3. Students will associate brain-directed 
activity with learning from previous 
experiences. 

Terminal Objective 303. students will associate sensory perception 

with learning and behavior. 

Subobjective 1. students will determine that some perceptions 
are attitudinal. 

2. Students will associate practice with learning. 

3. Students will associate learning with behavior. 
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UNIT IV. GROWTH & DEVELOPMENT 

Terminal Objective 400. Students will associate distinctions between 

the sexes with body parts and characteristics. 

Subobjective 1. Students will recognize differences that 
indicate sex. 

2. Students will recognize that people undergo 
sexual development, and that they do so at 
different rates and ages. 

Terminal Objective 401. Students will identify and distinguish 

functional roles of organs related to sex. 

Subobjective 1. Students will infer adolescent functions of 
female sex orgcuis. 

2. Students will infer adolescent functions of 
male sex organs. 

Terminal Objective 402. Students will infer social roles related to 

sex. 

Subobjective 1. Students will identify peer group relationships. 

2. Students will infer their potentia] roles as 
parents. 

Terminal Objective 403. Students will associate parental roles with 

the formation and development of a new 
individual. 

Subobjective 1. Students will relate functions of the male and 
female sex organs to the production of a new 
individual. 

2. Students will associate the period of 

pregnancy with fetal development, time, and 
changes in appearance of the mother. 

Terminal Objective 404. Students will relate changes in "life's 

continuum" to human growth and development. 

Subobjective 1. Students will infer infant-parent relationships 
based on infant needs. 

2. Students will determine the factors necessary 
for human growth and development. 

3. Students will identify and describe periodic 
changes in growth, development, and aging. 



ERLC 
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Terminal objective 405. Students will account for the phenomena that 

have contributed to the development of 
"Me Now." 

Subobjective 1. Students will distinguish between characteristics 
that are inherited and those that are not. 



